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FOREWORD 


Dr.  David  P.  Jacobus,  Director  of  the  Division  of  Medical  Chemistry 
at  the  Walter  Reed  Army  Institute  of  Research  (WRAIR)  felt  that  his  group 
could  profit  from  a  conference  on  applied  mathematics  with  special  emphasis 
on  areas  of  mathematics  now  being  used  in  medical  research.  He  discussed 
his  thoughts  on  this  matter  with  Dr.  John  Giese,  the  Chairman  of  the 
Conferences  on  Numerical  Analysis.  Such  a  symposium  would  point  out  the 
needs  of  mathematics  in  medical  science  and  would  help  interested  mathema¬ 
ticians  in  some  of  the  problems  developing  and  needing  solutions  in  this 
complex  field.  With  this  basic  philosophy  in  mind,  it  was  decided  to  hold 
the  1969  Army  Numerical  Analysis  Conference  at  WRAIR  in  Washington,  D.  C. 
on  24-25  April. 

At  the  request  of  Dr.  Jacobus,  Mr.  Alfred  Feldman  took  over  the  task 
of  selecting  the  invited  speakers.  He  also  served  as  Chairman  on  Local 
Arrangements.  Those  in  attendance  would  like  to  thank  him  for  all  his 
efforts  in  arranging  for  and  conducting  such  an  interesting  conference. 

"Mathematical  Methods  in  Biology  -  A  Review  of  Some  Successes  and 
Failures,"  was  the  title  of  the  talk  of  the  first  invited  speaker,  Professor 
Murray  Gerstenhaber  of  the  University  of  Pennsylvania.  The  second  invited 
address  entitled,  "Combinatorial  Designs  and  Computer  Aided  Search,"  was 
delivered  by  Professor  John  L.  Selfridge  of  the  University  of  Illinois. 

Both  of  these  talks  were  presented  on  the  first  day  of  the  conference.  The 
invited  speaker  for  the  second  conference  day  was  Dr.  Joseph  Mount  of  the 
offices  of  IBM  located  at  White  Plains,  New  York.  He  spoke  on,  "Medical 
Diagnosis  Through  Computer  Application  of  Bayesian  Inference."  We  are 
sorry  to  say  that  the  authors  of  these  three  papers  were  too  heavily 
committed  to  supply  this  office  with  copies  of  their  addresses.  Fortunately, 
the  authors  who  presented  the  contributed  papers  have  sent  in  their  manu¬ 
scripts.  These  are  published  here  and  they  give  a  general  idea  of  problems 
discussed  in  this  conference  and  are  an  important  contribution  to  the  field 
of  mathematics. 

The  Army  Mathematics  Steering  Committee,  the  sponsor  of  these 
conferences,  wish  to  thank  the  various  speakers  and  chairmen  for  their 
help  in  the  conduction  of  the  1969  Army  Numerical  Analysis  Conference. 
Members  of  this  committee  asked  that  these  Proceedings  be  issued  and  be 
distributed  to  those  in  attendance  at  this  Washington,  D.  C.  conference, 
as  well  as  to  other  interested  scientists. 
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THE  COMPUTATION  OF  RENEWAL  FUNCTIONS* 


Richard  M.  So  ind 

Research  Analysis  Corporation,  McLean,  Virginia 

ABSTRACT 

Renewal  theoretic  models  can  be  useful  tools  in  the  estimation  of 
future  demand  for  replacement  parts  and  in  other  areas  of  operations 
research.  Their  use  depends,  however,  on  the  availability  of  the 
renewal  functions  corresponding  to  specific  lifetime  distributions. 
The  basic  integral  equations  of  renewal  theory  appear  to  offer  a 
straightforward  and  practical  method  for  obtaining  the  necessary 
renewal  functions.  Tables  of  renewal  functions  corresponding  to 
gamma  and  Weibull  lifetime  distributions  have  been  published,  and 
the  method  of  computation  is  outlined  here. 


*This  paper  is  to  appear  as  a  Letter  to  the  Editor  in  Operations 
Research.  This  article,  along  with  extensive  tables,  has  appeared  as 
a  Research  Analysis  Corporation  Technical  Report,  RAC-TP-329 ,  under 
the  title,  "Renewal  Functions  for  Gamma  and  Weibull  Distributions 
with  Increasing  Hazard  Rate." 
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RANDOM  INVENTORY  MODELS  WITH  STATE-DEPENDENT  LEADTIMES 


Donald  Gross,'*  Carl  M.  Harris,  Frederic  A.  Miercort 
Research  Analysis  Corporation 
McLean,  Virginia 


ABSTRACT .  This  paper  describes  several  one-for-one  ordering  (S— 1 , S ) 
inventory  models  in  which  the  time  required  for  order  replenishment,  or 
leadtime,  depends  on  the  number  of  orders  outstanding.  Demand  is  assumed 
to  be  a  Poisson  random  variable  with  a  constant  mean  A,  and  leadtime  is 
assumed  to  be  state  dependent  in  either  one  of  two  ways:  (1)  the  contribu¬ 
tion  of  the  service  time  to  the  leadtime  is  an  exponentially  distributed 

-y(m) t 


random  variable  with  distribution  function  B  (t)  =  1  -  e 


where 


m 

m  is  the  number  of  outstanding  orders  just  after  the  previous  order  has 
been  filled  (viz.,  an  imbedded-Markov-chain  approach);  and,  (2)  the 
instantaneous  probability  at  an  arbitrary  point  in  time  of  an  order  being 
filled  (i.e.,  a  service  completed)  in  an  infinitesimal  interval  of  time 
At  is  y(n)At  +  o(At),  where  n  is  the  number  of  outstanding  orders  (viz.,  a 
birth-death  approach).  Several  models  are  investigated  for  each  type.  The 
orders  placed  are  assumed  to  go  into  a  single-server  queue,  and  queuing 
theory  results  are  used  to  obtain  the  expected  inventory  costs  as  a  function 
of  S  in  order  to  obtain  an  optimal  value  of  S.  Some  models  are  extended  to 
include  a  cost  dependent  on  mean  service  rate. 


INTRODUCTION.  This  paper  deals  with  a  class  of  inventory  problems  in 
which  order-replenishment  times,  or  leadtimes ,  are  state  dependent;  that 
is,  a  function  of  the  number  of  orders  outstanding.  Demand  on  the  inventory 
system  is  assumed  to  be  a  Poisson  random  variable  with  a  constant  mean  A. 
The  leadtime  is  assumed  to  be  state  dependent  in  one  of  the  two  following 
ways:  (1)  the  service-time  contribution  to  the  leadtime  is  an  exponentially 

distributed  random  variable  with  distribution  function  B^  (t)  =  1  -  e 

m 

where  m  represents  the  number  of  outstanding  orders  just  after  the  previous 
order  has  been  filled  (state  dependent  at  departure  points);  and,  (2)  the 
instantaneous  probability  at  an  arbitrary  point  in  time  of  an  order  being 
filled  (i.e.,  a  service  completed)  in  an  infinitesimal  interval  of  time 
At  is  u(n)At  4-  o(At) ,  where  n  is  the  number  of  orders  outstanding  (instan¬ 
taneous  state  dependence) . 

The  models  in  which  y(m)  is  used  are  analyzed  using  an  imbedded- 
Markov-chain  approach  while  the  models  utilizing  y(n)  are  treated  by  a 


*Donald  Gross  is  a  consultant  to  the  Research  Analysis  Corporation  and 
is  with  the  Department  of  Engineering  Administration,  The  George  Washington 
University,  Washington,  D.  C. 
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birth-death  analysis.  The  type  of  inventory  policy  considered  is  a 
one-for-one  ordering  policy  (a  special  (s,S)  policy  where  s  =  S  -  1) , 
and  thus  an  order  is  placed  whenever  a  demand  for  an  item  occurs.  It 
is  assumed  that  this  order  enters  a  single-server  queue  with  mean  service 
rate  y(k),  k  =  m  or  n  depending  on  the  particular  model  treated.  The 
system  is  shown  pictorially  in  Figure  1.  Complete  backlogging  is  assumed; 
that  is,  if  a  customer  arrives  and  there  is  no  on-hand  inventory  he  will 
wait.  Two  types  of  shortage  costs  are  considered,  a  cost  per  unit  short 
and  a  cost  per  unit  time  short.  In  addition,  inventory  is  charged  on  a 
per  unit  time  held  basis.  Values  of  S  which  optimize  the  above  cost 
considerations  are  found  for  a  variety  of  p(k)  functions.  Some  of  these 
models  are  extended  to  include  a  cost  dependent  on  p(k). 

In  the  next  section  the  general  methodology  of  formulating  and 
solving  models  with  carrying  and  underage  costs  only  is  presented.  Section 
III  gives  results  for  models  with  two  possible  rates  of  fulfillment,  one 
applying  with  only  one  order  outstanding  and  another  for  any  number  of 
outstanding  orders  greater  than  one,  for  both  instantaneous  and  departure 
state  dependency.  In  Section  IV,  results  are  presented  for  an  infinite 
number  of  allowable  values  for  the  mean  rates  (viz.  ,  p(k)  =  kap  for  k 
orders  outstanding)  for  both  instantaneous  and  departure  state  dependency. 
In  Section  V,  models  are  considered  with  an  additional  cost  introduced  as 
a  function  of  y. 


Demand  for 
Units  (Poisson,  X) 


Figure  1.  Inventory  System 

II.  METhODOLOGY  FOR  MODELS  CONSIDERING  OVERAGE  AND  UNDERAGE  COSTS. 
This  section  presents  the  general  methodology  for  determining  the  optimum 
value  of  S  when  overage  and  underage  costs  are  considered.  We  assume  here 
that  y  is  an  uncontrollable  but  known  function  and  that  the  total  cost  to 
be  minimized  is  the  sum  of  the  steady-state  expected  values  of  the  overage 
and  underage  costs  per  unit  time.  Consider  the  following  notation: 
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: 


C(S)  =  expected  overage  plus  underage  cost  per  unit  time 

Cj.  =  overage  penalty  cost  ($/unit/unit  time  held  on  shelf) 

Cg  =  underage  penalty  cost  ($/unit/unit  time  in  backorder) 

Cy  =  underage  penalty  cost  ($/unit  short) 

p  =  steady-state  probability  of  n  orders  outstanding  at 
any  time  t 

=  steady-state  probability  of  n  or  less  orders  outstanding 

n 

at  any  time  t(P  =  1  P^) 

k=0 

S  =  maximum  value  possible  for  on  shelf  inventory  (decision 
variable) 

“ ’  X  x 

X  =  demand  per  unit  time  with  f(x)  =  e  X  /x! 

It  then  follows  that  the  total  expected  cost  per  unit  time  may 
be  written  as 

S  00  00 

C(S)  =  Cj.  •  l  (S-n)pn  +  CB  ■  I  (n  -  S)pn  +  C yX  •  £  pn  .  (1) 

n=0  n=S  n=S 


The  optimal  value  S*  of  S,  providing  C(S)  is  unimodal,  is  therefore  given 
by  the  inequalities 


J  AC  (S*  -  1)  1  0  £  AC  (S*)  (S*  _>  1) 

\  0  <_  AC(0)  (S*  =  0)  , 

where  AC(S)  is  the  first  finite  difference  of  C(S)  =  C(S  +  1)  -  C(S). 

Equation  (2)  yields  the  following  decision  rule: 

S*  is  the  smallest  value  of  S  for  which 


(2) 


'VVVVs-'ii0'  (3) 

Since  a  one-for-one  ordering  policy  is  used,  every  time  a  demand  occurs 
an  order  is  placed,  and  hence  and  p^  depend  directly  on  f(x).  To 
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determine  p^,  a  queuing  problem  with  Poisson  input  must  be  solved  since 

the  orders  go  into  a  single-server  queue.  The  following  sections  treat 
the  specific  models  mentioned  in  the  introduction. 


HI.  TWO-STATE  SERVICE  RATES.  The  models  considered  in  this  section 
have  two  possible  mean  service  rates ,  one  appropriate  when  there  is  a  lone 
order  in  the  system  and  a  second  at  all  other  times.  Hence,  the  mean-rate 
function  may  be  written  as 


u(k)  =  { 


(k  =  0,1) 


(k  >  1) 


)  (k  =  m,n) , 


(4) 


where  m  is  interpreted  as  the  number  of  outstanding  orders  immediately 
after  an  order  has  been  filled  and  n  as  the  number  of  outstanding  orders 
at  an  arbitrary  point  of  time. 


Departure-Point  State-Dependent  Model 


Harris  in  [1]  derives  the  steady-state  departure-point  probabilities 
for  a  queuing  system  identical  to  the  order  queue  that  is  being  considered 
in  this  paper  using  an  imbedded-Markov-chain  analysis.  The  transition 
matrix  associated  with  the  Markov  chain  of  the  departure  process  of  the 
order  queue  is  given  by 


where 


P 


[Plji 


(5) 


k  =  Pr  {i  arrivals  during  a  full  service  period |j  in  system 
J  when  service  began} 


-  (1/i!)  I  (At)ie  U  dBx  (t)  , 
0  j 


(5a) 
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and  B  (t)  is  the  distribution  function  of  the  service  time  of  an  order 

j 

beginning  with  j  -  1  behind  it  in  line.  When  these  times  are  assumed 
exponential  with  means  l/y(m),  y(m)  given  by  (4),  the  service  distributions 
become 


bt  (t)  = 
j 


1  -  e'V  (j  =  1) 


1  -  e 


(j  >  1) 


and  hence 


01 

kll 

k21 

k31 

01 

kll 

k21 

k31 

0 

ko 

kl 

k2 

0 

0 

ko 

kl 

0 

0 

0 

ko 

, 

• 

where 


kil  =  A\/a  +  pl)1+1 


k.  =  Pr{i  arrivals  during  service  time|more  than  1  in 
system  when  service  began} 


=  a\i/(A  +  p)1+1. 

If  the  steady-state  departure-point  probabilities  are  denoted  by 
_n  =  ...)  and  are  the  solution  to  the  stationary  equation  ttP 

when  p  =  A/y  <  1,  then,  as  shown  in  [1], 

m-2 

r  m , ,  ,  ,  .m-1  r  m-k  k+1  .  ,  ,  .m-k-1, 

%  =  tpl^pl  +  +  l  P1  P  /  (Px  +  1)  ]ttq 

k=0 


m-k  k+1 , ,  ,  . .m-k-l, 

P1  P  ^P1  +  Jno 


mmm 


1 1  njvpp  ippBPBiippwwf 


and 


tTq  =  (1  “  p)/(l  +  Px  -  p  +  -  pp^  ,  (8) 

where  =  A/y^.  (The  reader  is  referred  to  [lj  for  complete  details  of 
the  above  derivations.) 

Although  the  elements  of  Tt_  are  indexed  on  the  number  of  orders  out¬ 
standing  just  after  the  previous  order  is  filled,  it  is  proved  in  the 
Appendix  that  these  are  identical  to  the  general-time  steady-state 
probabilities,  which  have  previously  been  denoted  by  {p^}  and  which 

are  required  for  the  inventory  model.  Thus,  using  equation  (8)  with 
equation  (3) ,  the  optimal  inventory  policy  can  be  determined. 

Instantaneous  State-Dependent  Model 

A  typical  birth-death  analysis  can  be  used  for  this  case  and  yields 
the  following  differential-difference  equations: 

/ 

dpQ(t)/dt  =  -ApQ(t)  +  UjP^t) 

I  dp1(t)/dt  =  -(A  +  y1)p1(t)  +  ApQ(t)  +  pp2(t)  (9) 

dpn(t)/dt  =  -(A  +  y)pn(t)  +  Apn_1(t)  +  ypn+1(t)  (n  >,  2) 

V 

The  steady-state  difference  equations  then  become 
/ 

0  =  -APq  +  ylPl 
J  0  =  -Apj^  -  P1P1  +  Ap0  +  yp2 

0  *  -ip„  '  ^  +  ‘Vl  +  “Pn+l 

\ 

The  solution  to  (10)  is  easily  found  to  be 

n-l  , 

p0  -  p  »1Pl  (■> 

where  p  =  A/y  and  p^  =  A/y^.  With  the  use  of  the  boundary  condition 


>  1) 


(n  >  2) 


(10) 


(ID 
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00 


y  p  =  1  it  is  found  when  p  <  1  that 
L  n 

n=0 


p0  -  a  -  p)/ci  -  p  +  px)  .  (12) 

The  optimal  inventory  policy  can  then  be  developed  by  substituting  (11) 
and  (12)  into  (3). 

For  each  of  the  two  models  described  above  nine  9x9  tables  were 
generated  using  the  CDC  6400  computer.  Each  table  varies  p  and  from 

0.10  to  0.90  in  increments  of  0.10,  giving  a  table  of  nine  rows  and  nine 
columns.  Nine  such  tables  were  obtained  for  each  model  varying  C  /C_ 

and  (AC^/Cj  over  the  values  0.5,  1.0,  and  10.0.  Tables  1  and  2  present 

sample  results  for  the  instantaneous  and  departure-point  state-dependent 
models,  respectively.  There  are  nine  such  sets  of  tables.  As  we  might 
expect,  these  models  exhibit  the  greatest  difference  when  p  and  are 

far  apart.  Table  3  shows  the  maximum  percentage  difference  of  total 
costs  for  each  of  the  nine  cases  run,  ranked  in  order  of  the  greatest 
difference  first.  The  subscript  convention  used  is  an  "i"  for  instan¬ 
taneous  and  a  "d"  for  departure-state  dependency. 

IV.  MANY-STATE  SERVICE  RATES.  The  models  considered  in  this  section 
have  the  mean  rate  function 

p(k)  =  kap  (k  =  m,n  and  a  >  0) ,  (13) 

where  m  and  n,  as  before,  are  the  number  of  outstanding  orders  immediately 
after  an  order  has  been  filled  (departure-point,  state  dependence)  and  the 
number  of  orders  outstanding  at  an  arbitrary  point  of  time  (instantaneous 
state  dependence)  respectively. 

Departure-Point  State-Dependent  Model 

The  service  times  are  again  assumed  to  be  independent  exponentially- 
distributed  random  variables  with  mean  l/y(m),  where  p(m)  is  given  by 
(13).  The  service-time  distributions  are  then 

.  Bt  (t)  =  1  -  e"m  Ut  (V  m)  .  (14) 

m 

The  { 7T  }  can  be  obtained  by  iteration  on 

in  * 
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TABLE  1  —  Instantaneous  State-Dependent  Model 

'  TABLE  ,.1A  ~  . 

_ I _ I _  _ _ 'I  OPTIMAL  S  _ 

1  i.o’f.  To) ~>  vo  rhcQZ=l  .  io.  ( .1  of ...  ?  o  "tla/c  i"s“T.'oq  .“lamb  dT>1"cu/c  i  =  i  o .  o  o 
t  r  "i_  i  "i“  2  '  2  5 


2 

2 

2 

2 

2 

3 

3 

4 

7 

1 

2 

2 

2 

2 

3 

3 

4 

5 

9 

2 

2 

2  . 

3 

3 

3 

4 

5 

Q 

RHO  1 

g 

2 

2 

3 

3 

4 

4 

6 

10 

2 

2 

3 

3 

3 

4 

_ 5. 

6 

...  10.  .... 

6 _ 1.0 _ 

6  _  ll.l  P 

aZZTqIZ 


_  _  TABLE  18 _  ..  _  ..... 

. . . . .  . . OPTIMAL  CCS)  .  _  _ _ 

io(.10)  _.90.  RHOT.=.  •  1 0  ( •  1  9  )  .90  Cb/CI  .=  1.00  LAMBDA  #  CU/CI 

Z  ’  .  i .  RhO  ■ 

1‘ZZ  2.03'  2.18  "  2,38  P.67  3.06  3.73  5.  13  9.19 

_ ...1 . 98  2,17  2, A 1  2.72  3,1*  _3. 73  4.54  6*  11  10,25 

Z.  Z 1 • 98  2.23  2,55  2,96  3,37  3,93  4.85  6.42  10,54 

1,97  .2,26  2.b6  3,06  3.44  4.09  4,97  6.58  10.64 

HOI .  _.  . .  . .  .  _ _ 

_ 1,9?_.  .2,33  .2.76  ..3,0.7 _ 3.50 _ 4 . 1 7  ...  5. 06  ._.6 , 64..  1 0 . 71 _ 

1  1 ,96  2.36  2,79  3.07  3.55  4,19  5,13  6*67  10.73 

1,96  l'2.4o  2.77  3.08  3,56  4.2o  5,13  ’  6.70  10,74 

_  1 ,96 2 . 4  2 2,76 3 , 0  8  _3 . 6  2.__  4 . 2 1  .5 , 1 4 6.72,10.75 

1,96  2.45  2,75  3.09  3,64  >".21  5.  14  6.73  10.76 


TABLE  2  Departure-Point  State-Dependent  Model _ _ _ _ 

VlT.IZl _ TABLE.  2A  .  "  ~~  .  ■ 

.  '  OP  T  1  MAL  S  . .  . 

,10(.10)  ,90  RrlO  1  =  .lG(.lO)  ,90  Cw/CI  =  1,00  LAMBDA  *  ClJ/CI  =  10.00 

RHO  1“' 


_ j _ i _ _ i :: _ i _ i _ i _ i _ i _ i. 


RHO l  . .  .  .  _  _ _ _ _ _ _ 

_  3.3  3  3.3  . 3  4  .  4-  -7— 


3  '  3  3  3  3  ........  4  . . 4  .....  5  ...  8 

3 _ 3 _ 3 _ _4 _ 4 _ 4 _ 5. _ 6 _ 9 

3  3  4  4  4  4  5  6  10 

3  4  4  4  4 _  5  5.  ...  7  .10 


_ 'I. ' . . . . TABLE  2t*  ’  ITl.'l.ll- .  .  .  .  .  ’ 

_i  optimal  c(sV“"  t.~~’ti  .  . 

, 1 0 ( , 1 0 )  , 90  RHO  1  =  .10  1,10)  ,90  CB/CI_s_. 1,00  LAMBDA  *  Cu/CI  =  1 0 . 0 0 

. . .  ..KhU _ 


1.91 

1.92 

1.94 

1.96 

1.99 

2.04 

'  2,14 

2,36 

3.27 

2,13 

2.17 

2.22 

2.29 

2.39 

2.55 

2,83 

3.49 

5.95 

2,3« 

2*45 

2.65 

2,bB 

2. 87 

3.16 

3,67 

4  W0 

8.26 

2.69 

2.81 

2.94 

3.06 

3.25 

3.59 

.4,21 

5.54 

9.50 

RHOl 

......  . . .  .2,91 

2.9  7 

3,07 

3.24 

3.50 

3.94 

-4.64 

.6.06 

10.10 

3, 03 

3.11 

3.25 

3.45 

3.78 

4.18 

4 . 91 

6.36 

10.41 

3.19 

3.29 

3.45 

3.70 

3.93 

4*36 

5.13 

6.57 

10.58 

3,3b 

3.4  91 

3,64. 

3.79.1 

4 •  0b_ 

4.55 

1.5,26. 

.  6 . 7  2  . 

IO.69 

3,56 

3,65 

3,73 

3.9o 

4.21 

4 . 66 

5,41 

6.83 

10.76 

_ _ _  ...  _ _ _  _  .  _  .  .  _ 

. 

.  .  _1  _ .  .  . 

_ 

11 

_ 

.  _  _ _ _  _ 

_ 

___  _ _  _ 

TABLE  3  —  Maximum  Percent  Differences,  Total  Cost 
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(15) 


TT  =  71  k  +  77  k  ,  +  TT  k  .  „  +  TT.k  „  „  +  .  .  .  +  TT  .  n  k„ 

m  0  ml  1  ml  2  m-1,2  3  m-2,3  m+1  0  ,m+l 


(m  =  0,1,2,.  , 


where  k  is  defined  as  in  (5)  and  (5a)  and  is  given  by 

=  AVp/U  +  j“p) 1+1  .  (16) 

The  sufficient  condition  for  ergodicity  is 


Ct 

lim  sup  {p^}  =  lim  sup  {A/(m  p) }  <  1 

(See  references  [1,2,  and  3].)  But  the  lim  sup  =  0  for  any  a  >  0  and 
hence  the  steady  state  exists  for  all  p  =  A/p  <  °°. 

It  is  shown  in  the  Appendix  that  the  {tt  }are  identical  to  the 
general-time  probabilities,  { } ,  and  therefore  equations  (15)  and  (16) 
can  be  used  with  equation  (3)  to  determine  the  optimal  inventory  policy. 

When  the  number  of  states  is  finite  £  can  be  determined  by  solving 
for  each  of  its  elements  in  terms  of  pQ  and  then  normalizing  according 

to  the  condition  that  probabilities  must  sum  to  one.  However,  when 

there  are  an  infinite  number  of  states,  the  {p  }  must  either  be  closed- 

m 

form  summable  (as  was  the  case  for  the  models  in  Section  III)  in  order 
to  obtain  p^  or  the  state  probabilities  must  be  determined  in  terms  of 

Pq  "sufficiently  far  out"  and  then  truncated  when  the  remaining  p^  are 

"small  enough."  For  this  model,  the  {p^}  are,  in  fact,  not  closed-form 

summable,  and  a  bound  could  not  be  analytically  obtained  on  the  actual 
size  of  the  tail  being  discarded;  i.e.,  no  N  could  be  found  such  that 

00 

V  p  <  e.  Instead,  successive  estimates  of  p^  were  computed,  and 
m=N 

truncation  was  then  allowed  when  the  difference  became  arbitrarily  small. 
The  procedure  goes  as  follows.  It  is  seen  that  one  may  write  Pm  (  =  ^ 

as  f  (p)pn,  where  f  (p)  can  be  found  exactly  by  successive  iteration  on 

(15).  Thus,  if  Pq  is  an  estimate  of  p^  =  1/ [ 1  +  £  f^Ip)]  based  on  M 

terms ,  then 

P0(M)  =  1/[1  +  l  fm(p)]. 

m=l 
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When 


t  (N) 
P0 


-  P 


(N+l) 


0 


<  e. 


N  is  taken  as  the  truncation  point.  This,  of  course,  gives  no  definite 

00 

information  on  the  bound  of  I  P  >  but  should  suffice  for  practical 


m=N 

purposes.  Cne  could  get  better  control  using  the  Cauchy  criterion;  i.ft., 
for  a  given  e,  N  is  such  that 


0 


(N)  _  -  (N+j)  < 


0 


for  all  j  >0.  However,  if  e  is  sufficiently  small,  j  =  1  should  be 
adequate. 

Instantaneous  State-Dependent  Model 

Using  a  birth-death  analysis  the  following  differential-difference 
equations  are  obtained: 


dpQ(t)/dt  =  -ApQ(t)  +  up^t) 
dpn(t)/dt  =  -(A  +  n%)pn(t)  +  Ap^^t)  +  (n  +  l)appn+1(t)  (n  >  1). 


(17) 


The  steady-state  difference  equations  then  become 


0  =  -AP()  +  uPl 


(18) 


0  =  -(A  +  nay)pn  +  Apn-1  +  (n  +  l)%Pn+^  (n  _>  1)  • 

The  solution  to  (18)  can  be  readily  found  by  mathematical  induction  to  be 

(19) 


pn  =  [pn/(n!)a]p0  , 


where 


P0  =  l/( 


I 

n=0 


Pn/(n!)a) 


(20) 


Although  (20)  is  in  closed  form  it  is  not  summable.  For  this  model,  a 
bound  on  the  error  involved  when  truncating  the  computation  can  be  obtained 
when  a  >  1. 
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Consider  a  comparison  between 


pn  =  PQ  (  A/p) n/ (n!)“ 

and 

Pn  =  w)n/nJ  , 

that  is,  between  this  model  and  M/M /°°,  the  so-called  ample-server  model. 
For  a  _>  1  and  p  =  A/p, 

p  / (n! )  _<  p  /n! 

for  all  n,  and  hence 

p  l  [pn/(n!)“]  <  l  [pn/(n!)“] 

n=N  n=N 

<  l  [ pn/n ! ] . 

n=N 

But  the  right-hand  side  of  the  above  is  the  tail  of  the  series  for  ep, 
and,  therefore,  given  an  arbitrary  e  >  0,  there  exists  an  N  such  that 

00 

l  [ pn/n! ]  <  E, 
n=N 

and  thus 

p  l  [pn/(n!)a]  -l  p 
n=N  n=N 

oo 

£  l  [ pn/n ! ]  <  E. 

n=N 

N  is  then  the  first  index  for  which 

N-l 

eP  -  l  [ pn/n ! ]  <  e. 

n=0 
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For  a  <  1,  a  procedure  similar  to  that  of  the  departure-point  model 
is  used.  Here 


and 


f 

n 


pn/(n!) 


a 


M 

i/a  +  j  o  . 

m-1 


The  truncation  point  N  is  such  that 


;(N+1) 

P0 


£. 


Nine  tables  were  again  generated  for  each  model,  using  CL/Ct  and 

D  I 

XCy/Cj  equal  to  0.5,  1.0,  and  10.0.  Each  table  was  10  x  10,  with 

p  =  .1(. 10)1. 00  and  a  =  0.2(.2)2.00.  Sample  results  are  presented  in 
Tables  4  and  5.  Table  6  presents  the  maximum  percent  difference  in  total 
costs  for  the  nine  cases  run.  For  these  models,  since  the  service  rate 
always  goes  down  with  system  size,  the  instantaneous  state-dependent  model 
is  always  cheaper. 

V. _ MANY-STATE  SERVICE  RATE  MODELS  WITH  A  CHANGE-OF-STATE  COST. 

The  models  of  the  previous  section  will  now  be  considered  with  an  additional 
cost  associated  with  the  number  of  state  changes.  This  cost  represents  a 
set-up  cost  incurred  whenever  there  is  a  change  in  the  mean  service  rate. 
Thus,  equation  (1)  is  to  be  modified  and  now  becomes 

S  00  CO 

C'(S)  =  4  ■  I  (S-n)pn  +  CB  I  (n-S)pn  +  C^X  £  pn  +  CRN  ,  (21) 

n=0  n=S  n=S 


where  CD  is  the  set-up  cost  for  changing  the  mean  service  rate  and  N  is 

the  expected  number  of  such  changes  per  unit  time.  Since  S  does  not  appear 
in  the  added  cost  term,  the  optimum  S,  S* ,  is  not  changed.  However,  C(S*) 
does  change  and  adding  a  cost  for  each  change  of  mean  service  rate  will 
now  penalize  the  instantaneous  state-dependent  model  more  than  the  departure 
point  state-dependent  model  since  the  former  has  a  greater  number  of  changes 

Since  the  process  is  in  the  steady  state,  the  expected  number  of 

replenishments  per  unit  time  must  equal  the  expected  number  of  orders 

placed  per  unit  time,  which  for  the  one-for-one  ordering  policy  is  merely 

X.  Thus,  the  expected  total  number  of  state  changes  per  unit  time  is  equal 

to  2X.  However,  CD  is  not  incurred  at  all  of  these  changes.  For  the 
K 

instantaneous  state-dependent  model,  C  is  not  incurred  when  the  system 

K 

goes  from  state  E^  to  E^  or  from  state  E^  to  E^ .  Thus,  for  this  model. 
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TABLE  4  --  Instantaneous  State-Dependent  Model 

TABLE  4 A 

optimal  S 

RHO  =  ,!(.(,  10)1. 00  ALPHA  =  .?()(. 20)2. 00  CH/CI  =  1.00  LAMBDA  *  Cll/Cl  =  10.00 


1 

) 

1 

1 

) 

ALPHA 

] 

1 

1 

1 

1 


?  2  2 

2  2  2 

2  2  2 

?  2  2 

2  2  2 

2  2  2 

2  2  2 

2  2  2 

2  2  2 

2  2  2 


RHO 

3  3  4 
3  3  3 
3  3  3 
2  3  3 
2  3  3 
2  2  3 
2  2  3 
2  2  2 
2  2  2 
2  2  2 


4  5  6 
4  4  4 
3  3  4 
3  3  3 
3  3  3 
3  3  3 
3  3  3 
3  3  3 
2  3  3 
2  2  3 


TABLE  4B 
OPTIMAL  CIS) 

RHO  ~  .10l.10n.00  ALPHA  =  .2  0  (.20)2.00  CB/CI  =  1 .  C  0  LAMBDA  *  Cu/CI  =  10.00 

KHO 

l.c*r  ?.)1  2.39  2. 82  3.06  3.40  3,80  4.17  4.6?  5.15 

1.04  2.07  2 , 2  R  2.60  2.H6  3.0?  3,26  3.*5a  3.7)  3.96 

l.Pft  2,03  ?.2{i  2.A5  2.75  2.B2  2.94  3.1?  3.35  3.44 

1,67  ?. On  2,13  2.33  2.66  2.70  2,76  2. 65  2,9 P  3.14 

1.66  1.90  2,08  2.23  2,43  2.64  2.65  2.7  fi  2.74  2.85 

ALPHA 

1.66  1.9o  2.03  2.16  2.32  2,51  2.59  ?,60  2.63  2.67 

1.85  1.9a  2, CO  2.09  2,22  2.36  2.56  2. 5a  2.55  2.56 

1.85  1 .9.3  1,96  2.04  2.14  2,27  2,4?  ?.5l  2.5n  2.50 

l.H*  1.9)  1.94  1.99  2.08  2.16  2,30  2.43  2.47  2.46 

1,84  1,9'  1,9]  1.96  2,0?  2,10  2.20  2.3]  2.43  2.43 
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TABLE  5  --  Departure-Point  State-Dependent  Model 

TABLE  5A 

OPTIMAL  S 


:  .  10  (  .  J  0)  1  .00 

ALPHA  = 

.20  ( 

.20)2. 

00  CB/CI 

RHO 

” 

1.00 

LAMBDA 

a  CM/CI 

=  10.00 

1 

2 

2 

3 

3 

3 

4 

5 

5 

6 

1 

2 

2 

3 

3 

3 

4 

4 

5 

5 

1 

2 

2 

2 

3 

3 

4 

4 

4 

5 

1 

2 

2 

2 

3 

3 

3 

4 

4 

4 

1 

ALPHA 

2 

2 

2 

3' 

3 

3 

4 

4 

4 

1 

2 

2 

2 

3 

3 

3 

3 

4 

4 

1 

2 

2 

2 

3 

3 

3 

3 

4 

4 

1 

2 

2 

2 

3 

3 

3 

3 

4 

4 

1 

2 

2 

2 

3 

3 

3 

3 

4 

4 

1 

2 

2 

2 

3 

3 

3 

3 

3 

4 

TABLE  5  B 
OPTIMAL  C(S> 

RHO  =  ,10(.10)1,00  ALRhA  =  .20 {,20)2,00  Ctf/Cl  =  1,00  LAMBDA  «■  Cii/CI  =  10,00 

RHO 


1.91 

?  .  1  6 

2. bo 

2.97 

3.24 

3.69 

4.05 

4.5? 

4.98 

5.47 

1.91 

2.15 

2.^7 

2,91 

3.11 

3.4? 

3.7? 

3.96 

4.26 

4.46 

1.91 

2.14 

2.44 

2,86 

3.03 

3.27 

3,58 

3.71 

3.9o 

4.12 

1.91 

2.14 

2.42 

2.8.1 

2.98 

3.18 

3,43 

3.59 

3.7) 

3.88 

1.91 

2.  n 

2,40 

2.77 

2.95 

3.12 

3.33 

3.54 

3.6? 

3.74 

1.91 

2.1  3 

2.39 

2.75 

2.93 

3.07 

3.27 

3.49 

3.57 

3.66 

1.90 

2.12 

2,38 

2.72 

2,91 

3.05 

3.2? 

3.43 

3,55 

3.63 

1.90 

2.12 

2.37 

2.70 

2.90 

3.03 

3.19 

3.36 

3.54 

3.61 

1,90 

2.12 

2.35 

2,b9 

2.89 

3,01 

3.17 

3.35 

3.54 

3.60 

1.90 

2.12 

2.36 

2.68 

2.o9 

3.00 

3.  15 

3.33 

3.5? 

3,60 
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ALPHA 


N  =  A[Pr{change  due  to  an  arrival}  +  Pr {change  due  to  a  departure}] 

=  A[Pr  tstate  E  t  E.  }  +  Pr{state  E  /  E.  |E  4  E„}] 

n  0  n  1  1  n  0 

=  A [  ( 1  -  pQ)  +  (1  -  pQ  -  p^/d  -  pQ)]. 

For  the  departure-point  model,  CD  is  incurred  at  every  departure  point 

R  jj 

except  those  leaving  an  idle  server.  Since  the  number  of  departure  points 
per  unit  time  is  A,  then,  for  this  model, 

N  =  A(1  -  pQ)  . 

The  total  costs  for  an  optimum  policy  are  now  given  by 

C'(S*)  =  C±(S*)  +  CrA[1  -  p  +  (1  -  P0  -  Px  )/(l  -  p0  )]  (22) 

i  i  i  i 

and 

ci(si)-cd<s5)  +  cRx(1-v*  I 

a 

. 

where  C ^  ( • )  is  the  cost  previously  calculated  free  of  the  charges  for 

state  changes,  and  "i"  and  "d"  again  give  reference  to  the  specific 
model  used. 

*  tj 

The  comparative  break-even  value  for  C  can  be  found  from  (22)  and  j 

K 

is  given  by 

CR  “  {Cd(Sd)  ‘  CI(Si)}/U[1  +  P0  "  P0  "  P1  /(i-Po)^.  (23) 

d  i  i  i  ] 

Hence,  if  CL  is  larger  than  C°,  then  the  departure-point  state-dependent 

R  K  j 

model  is  advantageous  with  respect  to  total  cost.  When  C  is  less  than  > 

C°  the  opposite  is  true.  Table  7  shows  values  of  AC  for  C„/C  =  1.00, 

R  K  o  1 

ACy/Cj.  =  10.00,  and  a  =  .  20  (  .  20)  2 . 00  ,  p  =  .10(  .10)1.00.  | 


20 

j 


TABLE  7 


LAMhOA  *  CRZEPO 

RHO  =  .  1 0  ( .  1 0 )  ]  .(0  ALPHA  =  ,2C<.20)?,00  CB/CI  =  1.00  LAMBDA  «  C|J/CI  =  10.00 

RHO 

,]B  ,2fi  .43  .45  .45  .63  .47  .Bp  .53  .43 

.31  .59  ,9n  1.17  ,79  1.08  1,05  .fl5  1.03  .84 

.61  .94  1.44  1.90  1.10  1.48  1.82  1.40  1,25  1,42 

.7?  1.3*  2.07  2.73  1.88  1.9q  2,35  2.29  2.03  1.84 

1.00  1.87  2.8*  3,77  2.98  2.36  2.93  3.2o  2.9?  2.71 

alpha 

1.3?  2. Bo  3.86  5.11  4.4]  3.49  3.63  4.23  3.97  3.73 

1.70  3.33  b.lfi  6.91  6.36  5.27  4.56  5.28  5.29  4.99 

2.1b  4.34  6.97  9,46  9.17  7.85  6.93  6.7*  7.07  6.66 

2.77  5.74  9.57  13.33  13,54  11,89  10.63  9.64  9.66  9.02 

3.6?  7.7?  13.6?  ]9.85  21,25  19.11  17.16  15.44  13.96  12.71 
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APPENDIX .  The  results  derived  for  the  imbedded  chain  of  the  departure- 
point  state-dependent  queuing  problem  can  be  directly  applied  to  the 
general-time  probability  that  the  state  of  the  system  is  n.  In  fact, 
it  can  be  shown  that  since  the  arrivals  are  Poisson,  the  imbedded  prob¬ 
abilities  and  the  general-time  probabilities  are  equal.  That  is, 

tt  =  lim  Pr{X 
n 

J*°° 

=  lim  Pr{X(t)  =  n|x(t)  =  number  in  system  at  time  t}  =  p  . 

t-v°° 

To  show  this,  consider  a  specific  realization  of  the  actual  process 

over  a  long  interval  of  time  T.  If  A  (t)  denotes  the  number  of  unit  upward 

n 

jumps  (arrivals)  from  state  n  occurring  in  (0 , t ]  and  D  (t)  the  number  of 
unit  downward  jumps  (departures)  to  state  n  in(0,t],  then 


=n]x.  =  number  in  system  just  after  the  j  departure} 


|An(T)  “  Dr(T)  |  <  1. 


As  long  as  the  system  is  unsaturated,  this  is  true  for  <  1,  the 

ratio  of  the  total  number  of  departures  D(T)  to  arrivals  A(T)  must  go 
to  1  as  T  goes  to  infinity.  Hence 


A  (T)  D  (T) 

n  n 

lim  -  =  lim  - 

T-*°  A(T)  T-*30  D(T) 


(1) 


with  probability  one. 

Since  arrivals  occur  at  the  points  of  a  Poisson  process  operating 
independently  of  the  state  of  the  process,  lim  [A  (T)/A(T)]  is  identical 

T-xo  n 

with  the  general-time  probability  p^.  But 


TT 

n 


lim 

T-*» 


[Dn(T)/D(T)]. 


Hence,  from  (1) 


REFERENCES 


1.  C.  M.  Harris,  "Queues  with  State-Dependent  Stochastic  Service 

Rates,"  Operations  Research,  15:  117-130  (1967). 

2.  T.  B.  Crabill,  "Sufficient  Conditions  for  Positive  Recurrence  and 

Recurrence  of  Specially  Structured  Markov  Chains,"  Operations 
Research ,  16:  858-867  (1968). 

3.  P.  T.  Holmes,  "Generalizations  of  Two  Theorems  of  Foster,  and  an 
Application  to  a  Markov  Chain  which  Arises  in  the  Study  of  Queues 
with  State-Dependent  Service  Times,"  Rutgers-The  State  University, 
New  Brunsw^Jc,  New  Jersey,  1969  . 

4.  R.  W.  Conway  and  W.  L.  Maxwell,  "A  Queueing  Model  with  State 

Dependent  Service  Rate,"  The  Journal  of  Industrial  Engineering, 
12:  132-136  (1961). 

5.  H.  P.  Galliher,  P.  M.  Morse,  and  M.  Simond,  "Dynamcis  of  Two 

Classes  of  Continuous-Review  Inventory  Systems,"  Journal  of  the 
Operations  Research  Society  of  America,  7:  362-382  (1959). 

6.  D.  L.  Iglehart,  "Recent  Results  in  Inventory  Theory,"  The  Journal 

of  Industrial  Engineering,  18:  48-51  (1967). 

7.  T.  L.  Newberry,  "A  Classification  of  Inventory  Control  Theory," 

The  Journal  of  Industrial  Engineering,  9:  391-397  (1960). 


23 


*'  i  ■*  \  '-U  f  t' 


TIME  SHARING 


R.  S.  Triplett 

National  Civil  Defense  Computer  Facility 
Olney ,  Maryland 


I  wish  to  thank  you  for  this  invitation  to  present  to  you  a 
short  paper  on  time  shared  computer  systems.  This  is  a  subject  in 
which  I  am  doing  research  at  the  present  time,  hopefully,  with  the 
result  that  I  can  make  some  significant  contribution  to  the  Army's 
program  before  too  many  more  months  have  passed.  This  paper  today, 
however,  will  reveal  no  startling  results  of  specific  research  on 
some  particular  aspect  to  time  sharing.  I  have  been  asked  merely 
to  make  a  talk  on  time  sharing  in  general,  and  cover  a  few  selected 
topics . 

The  subject  of  time  sharing  is,  of  course,  a  broad  subject  and 
includes  so  many  different  facets  of  software  and  hardware  that  a 
speaker  could  talk  for  months  without  pausing  to  take  a  breath  and 
make  only  a  dent  in  the  subject.  Some  authorities  don't  even  like 
the  term,  "time-sharing."  My  good  friend,  Dr.  Herbert  Robinson, 
former  president  and  chairman  of  CEIR,  once  wrote  an  article  in  which 
he  deplored  the  use  of  the  term,  "time-sharing,"  and  recommended  the 
term,  "multiple-access,"  instead.  But  the  term,  "time-sharing,"  lives 
on  nevertheless  and  will  no  doubt  be  with  us  for  many  years  to  come. 

And  the  reason  for  that  is  psychological.  The  inventors  of  third 
generation  computer  systems  want  you,  the  user,  to  think  of  yourself 
as  having  the  computer  under  your  personal  control  and  doing  work  on 
it  concurrently  with  the  other  scientists  in  your  laboratory.  Of 
course,  the  central  processing  unit  (CPU)  is  taking  you  each  in  turn, 
giving  you  each  a  slice  of  time  according  to  priority  or  according 
to  which  one  of  the  users  contacted  the  system  first.  But  you  are 
never  aware  of  the  fact  that  you  are  queued  up  waiting  for  service 
except  when  the  executive  system  fails  to  function  properly  and  gives 
some  one  user  too  big  a  time  slice  or  in  case  the  executive  system 
permits  one  high  priority  long  running  program,  such  as  a  real  time 
scientific  application,  to  finish  out  before  you  get  a  chance  to  get 
a  slice  of  time,  The  executive  system,  as  you  can  see,  has  a  lot  to 
do  with  the  way  a  time-shared  computer  system  operates.  But  we'll  have 
more  to  say  about  executive  systems  later.  Let  us  get  back  now  to  the 
definition  of  time  sharing. 

It  might  be  best  to  start  our  discussion  of  time-sharing  by 
defining  time  sharing  as  the  overlapping  of  certain  functions  of  the 
computer  and  then  later  provide  a  definition  based  upon  more  advanced 
systems.  Back  in  the  early  days  of  computers,  the  operator  sat  at  a 
console  and  fed  his  work  into  the  computer.  Then  the  CPU  went  to  work 
on  it  and  output  the  results.  After  the  output  was  finished,  the  CPU 
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sat  idle  until  the  next  job  was  input  to  the  computer.  Then  it  went 
to  work  on  the  second  job  and  output  the  results.  The  operator  could 
at  any  time  stop  the  computer  and  engage  in  console  debugging,  read  an 
item  from  a  tape  or  drum,  or  perform  some  other  operation.  The  Central 
Processor  Unit  operated  in  fits  and  starts.  But  even  though  the  CPU 
was  inactive  a  good  part  of  the  time,  you  continued  to  pay  rent  on  it. 

And  at  $50,000  per  month,  or  $5  per  minute,  for  the  entire  system,  you 
came  to  be  aware  of  system  idleness  and  of  the  need  to  perform  some 
benefit-cost  studies  that  might  lead  to  more  return  on  your  investment 
in  the  several  elements  of  the  computer  system.  So  you  developed  better 
systems  which  enabled  you  to  input  one  program  to  the  computer  while 
the  CPU  was  working  on  another.  Then  you  could  output  the  first  program 
while  the  CPU  was  working  on  the  second.  In  this  way  you  time  shared 
the  computer  system  in  the  sense  that  both  CPU  and  input /output  devices 
were  doing  work  concurrently. 

Take  a  look  at  slide  one.  Here  we  have  an  IBM  360  being  time 
shared  between  two  tasks,  one  high  priority  and  the  other  low  priority. 
Task  A  is  the  high  priority  task  and  is  in  control  of  the  situation. 

At  the  beginning  of  our  time  span,  task  A  uses  the  CPU  and  task  B  is 
idle.  Then,  task  A  initiates  a  read  operation.  At  this  point,  the 
CPU  is  turned  over  to  task  B  until  the  read  operation  is  finished,  at 
which  time  task  A  reclaims  the  CPU.  Then  task  A  initiates  a  write 
operation  allowing  task  B  to  claim  the  CPU  until  the  write  operation 
is  completed. 

Notice  that  the  above  time  sharing  takes  place  in  a  multi-programming 
mode,  that  is,  with  more  than  one  program  stored  in  the  computer  and 
ready  for  execution.  Actually,  if  we  speak  of  time  sharing  as  an  act 
where  input/output  operations  take  place  concurrently  with  CPU  opera¬ 
tion,  it  is  not  necessary  to  multi-program  a  computer.  Back  in  the 
earlier  days  of  computers,  overlapping  of  I/O  operations  and  CPU  took 
place.  Unless  my  memory  fails  me,  the  IBM  7090,  1401,  UNIVAC  III, 
and  UNIVAC  File  Computer  were  among  the  earlier  computers  that  had 
this  capability. 

But  it  is  in  the  multi-programming  mode  of  operation  that  time 
sharing  has  come  into  prominence.  For  with  multi-programming,  dif¬ 
ferent  users  can  run  their  program  concurrently,  or,  to  what  appears 
to  them  to  be  concurrently.  I  don't  know  the  precise  date  of  the 
first  experimental  multi-programmed  computer,  but  I  do  recall  making 
a  first  fumbling  effort  myself  back  in  1956  to  develop  a  form  of 
multi-programming  for  the  Army  on  the  UNIVAC  File  Computer  and  UNIVAC 
1103A  Computer.  This  was  a  scheme  whereby  the  Army  could  obtain  data 
from  a  file  stored  in  the  computer  without  feeding  in  a  separate  pro¬ 
gram  to  search  the  file.  The  file  search  program  was  stored  in  the 
computer  permanently  and  could  be  called  whenever  the  operator  punched 
a  certain  button  on  the  console.  All  programs  written  for  the  computer 
had  a  software  look-up  feature  which  required  that  they  periodically 
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search  a  certain  memory  location  for  the  presence  of  1  bit.  Normally, 
a  zero  bit  was  maintained  there,  and  if  the  user  program  found  a  zero 
bit  there  it  would  continue  with  the  processing  of  the  user  program. 
However,  if  the  operator  inserted  a  1  bit  in  this  particular  memory 
location,  the  user  program  would  branch  to  the  file  search  routine, 
read  in  a  card  or  give  heed  to  certain  data  fed  in  from  the  console 
by  the  operator.  The  file  search  program  would  provide  the  needed 
information  to  the  console  printer  or  other  output  device,  replace 
the  1  bit  with  a  zero  bit,  and  branch  back  to  the  user  program. 

There  were  two  undesirable  features  to  this  scheme.  One  of  them 
was  the  amount  of  time  required  by  the  user  program  to  periodically 
search  for  the  presence  of  the  1  bit.  Normally,  in  present  day  computer 
operation  we  prefer  hardware  interrupts  to  software  searches  -  which 
may  or  may  not  lead  to  actual  interrupt  of  a  program. 

Another  undesirable  feature  was  that  the  operator  probably  had 
to  stop  the  computer  in  order  to  feed  the  1  bit  into  the  appropriate 
memory  location.  As  you  well  know,  stopping  the  computer  from  the 
console  or  permitting  a  user  program  to  stop  a  computer  are  things 
of  the  past. 

But  in  spite  of  the  above  undesirable  features,  there  was  one 
desirable  feature  which  outweighed  the  undesirable  ones.  We  could 
search  the  file  and  retrieve  the  desired  management  information  with¬ 
out  the  necessity  of  waiting  for  completion  of  the  user  program  and 
then  feeding  into  the  computer  a  second  program  for  the  purpose  of 
doing  the  file  search.  We  could  get  the  needed  file  information  into 
the  hands  of  the  impatient  manager  much  more  quickly  than  if  we  had 
forced  him  to  wait  for  completion  of  a  long  linear  programming  problem 
that  might  have  required  several  hours  to  complete. 

The  above  scheme  serves  to  illustrate  some  of  the  desirable 
features  of  multi-programming.  We  have  more  than  one  program  stored 
in  the  computer  at  a  time  and  we  can  make  any  of  the  user  programs  - 

depending  on  which  one  happened  to  be  running  at  the  time  -  call  into 

operation  the  file  search  program.  Thus,  we  have  time  sharing  in  the 
sense  that,  during  a  certain  time  span,  more  than  one  program  can  be 
working  without  the  necessity  of  the  operator  feeding  in  the  second 
program. 

Actually  in  modern  day  multi-programming,  the  executive  system 
is  in  complete  charge.  It  takes  the  user  programs  in  accordance  with 
priority,  or  when  there  are  hardware  interrupts,  queues  them  up,  and 
starts  them  into  operation.  No  one  user  program  is  permitted  to 
interfere  with  another  user  program.  If  it  attempts  to  write  into 
another  user's  program  or  read  from  another  user's  file  there  is  an 
interrupt  which  removes  the  offending  program  from  main  storage  and 
sends  a  message  to  the  console.  But,  of  course,  the  computer  doesn't 

stop.  It  keeps  on  with  the  task  of  processing  those  programs  already 

in  the  computer. 
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There  were  other  defects  in  earlier  generation  computers.  If 
the  physicist  got  onto  the  computer  first,  the  chemist  had  to  wait 
his  turn  some  time  later  in  the  morning.  And  when  the  chemist  was 
through,  the  mathematician  got  his  runs  in  late  in  the  afternoon. 

And  furthermore,  he  had  to  leave  his  office  to  do  it.  He  went  down 
to  the  computer  center,  handed  his  deck  of  cards  into  the  window, 
went  back  to  his  office  and  waited.  By  the  time  he  got  his  results 
back,  he  had  forgotten  what  he  was  doing. 

So  the  next  step  was  to  develop  a  computer  system  which  would 
enable  many  different  users  to  enter  the  system,  preferably  from 
their  own  offices  where  their  instruments,  professional  library,  and 
other  material  was  located.  Now  the  physicist  could  work  on  a  problem 
in  Fortran  IV  while  the  mathematician  used  Algol.  And  in  the  meantime, 
the  operator  at  the  central  site  could  be  preparing  the  flash  sales 
report  or  making  an  inventory  run.  For  all  practical  purposes,  he 
didn't  even  know  the  physicist  or  the  mathematician  existed. 

Thy  physicist  and  the  mathematician  might  be  in  communication 
with  the  computer  in  a  conversational  manner  through  use  of  conversa¬ 
tional  BASIC  or  Fortran.  With  these  high  level  languages  the  scientist 
can  from  his  remote  terminal  write  a  program  while  he  thinks.  Some 
conversational  software  packages  will  edit  his  program  as  he  writes 
it;  thus,  telling  him  as  he  writes  each  instruction  whether  or  not  the 
instruction  is  legal.  Other  conversational  packages  wait  until  the 
entire  program  is  compiled,  then  diagnose  it.  If  there  are  errors  in 
the  program,  a  complete  diagnosis  is  furnished  the  remote  user.  If 
the  program  is  legally  constructed  the  computer  sends  back  the  message, 
READY.  The  programmer  will  now  hit  the  run  button  and  await  results. 

If  he  is  an  experienced  programmer,  he  will  write  his  program  so  that 
intermediate  results  are  printed  out  on  the  teletype.  Then  if  these 
results  don't  agree  with  his  precalculations  he  can  ask  for  a  program 
listing  by  typing  LIST  on  the  teletype  keyboard.  He  then  examines  his 
program,  finds  the  errors,  types  in  the  corrected  statements,  and  hits 
the  run  button  again.  This  time,  hopefully,  the  program  runs  perfectly. 

If,  when  the  programmer  asks  for  a  listing,  makes  a  correction,  or 
hits  the  run  button,  the  computer  is  busy,  the  simple  word,  WAIT,  is 
typed  out  on  the  carriage  of  the  teletype.  When  the  computer  is  ready, 
it  performs  the  desired  work,  automatically,  and  without  the  necessity 
of  the  programmer  repeating  the  text  of  his  remote  inquiry. 

When  a  programmer  comes  into  the  computer  system  from  a  remote  site, 
or  at  the  centralized  site,  his  program  is  put  into  a  queue  along  with 
the  other  programs  and  taken  in  turn  according  to  priority.  The  capacity 
of  the  CPU  to  take  each  of  several  programs  in  turn,  and  run  it,  is,  of 
course,  known  as  multi-programming.  If  the  computer  has  more  than  one 
CPU,  the  system  is  said  to  have  multiprocessing.  But  whether  it  has 
both  multi-programming  and  multiprocessing,  or  not,  the  aims  are  the 
same : 
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a.  To  give  the  user  the  feeling  that  he  is  in  contact  with 
the  system. 

b.  To  shorten  turn  around  time. 

c.  To  effect  greater  utilization  of  computer  components. 

d.  In  the  case  of  multiprocessing,  to  provide  more  system 
reliability  and  speed  (some  computer  systems  having  more 
than  one  CPU  can  place  the  workload  on  only  one  CPU  while 
the  other  CPU  is  being  repaired) . 

By  now,  you  are  probably  wondering  if  there  is  not  some  price  to 
pay  for  all  of  this  third  generation  sophistication  that  we  have  just 
described.  The  answer  is:  plenty.  The  executive  systems  needed  to 
operate  these  computer  systems  are  the  most  complex  software  packages 
ever  developed.  Many  man-years  are  required  to  develop  them  and  some 
of  them,  that  have  been  on  the  market  for  some  time,  still  do  not  work 
very  well  and  are  still  being  revised.  Litigation  is  being  pursued, 
or  at  least  discussed,  because  of  the  failure  of  one  manufacturer  of  my 
acquaintance  to  provide  an  executive  system  that  works.  Some  of  the 
defects  noticed  were: 

a.  The  executive  system  was  not  properly  documented. 

b.  The  executive  system  at  times  completely  wiped  out  the  master 
directory  of  programs  stored  on  a  peripheral  device. 

c.  When  one  particular  teletype  came  into  the  system,  the 
executive  couldn't  get  rid  of  it:  it  apparently  hung  on 
for  dear  life. 

But  it  is  significant  to  note  that  this  particular  executive 
system  of  which  I  speak  has  been  roundly  praised  by  its  users  as  being 
the  best  executive  system  on  the  market.  So  we'll  just  have  to  be 
patient  and  see  what  happens . 

Let  us  take  a  look  at  slide  2  to  see  how  three  programs  -  referred 
to  as  tasks  -  are  time  shared.  Here  the  executive  system  gives  each 
task  a  slice  of  time.  Notice  that,  at  the  beginning,  task  A  is  in  con¬ 
trol  of  the  CPU.  Then  at  point  A,  task  A  initiates  a  READ  operation  and 
task  B  takes  over.  Then  at  point  B,  task  A's  read  <  peration  is  completed 
and  it  regains  control  until  its  slice  of  time  expires  at  point  1.  Then 
task  B  receives  control  until  it  initiates  a  read  operation  at  point  C. 

At  that  point,  task  C  takes  over  the  CPU  until  we  reach  point  D  where 
task  B's  read  operation  is  completed.  Task  B  regains  control  until  its 
time  slice  ends  at  point  2.  Then  task  C  takes  over  and  runs  until  its 
time  slice  ends  at  point  3.  Now  we  are  ready  to  give  task  A  another 
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time  slice.  Then  task  B  commences  its  second  time  slice  at  point  4 
and  runs  until  a  write  occurs  at  point  E.  At  this  time  task  C  takes 
over  until  the  write  operation  of  task  B  is  completed.  Then  control 
reverts  to  B  until  the  end  of  its  time  slice  at  point  5.  Task  C  takes 
over  until  it  initiates  a  read  operation.  Then  control  goes  to  task  A 
until  the  read  operation  is  completed,  at  which  time  task  C  finishes  its 
time  slice  at  point  6.  Now  it  is  time  to  give  task  A  the  opportunity  to 
finish  its  time  slice,  which  it  does.  And  we  are  now  at  point  7. 

As  you  can  sense  from  the  above  discussion,  the  problem  of  handling 
program  priority,  time  slices,  read  ins,  printouts,  etc.,  is  an  involved 
operational  problem  which  would  task  the  agility  of  competent  operations 
researchers,  particularly  when  there  are  fifteen  or  twenty  users,  all 
seeking  to  use  the  computer  at  the  same  time.  With  the  Executive  8 
system  provided  with  the  UNIVAC  1108,  there  are  three  modes  of  operation 
within  each  of  which  priorities  can  be  set.  One  mode  is  real  time.  This 
mode  takes  top  priority.  Real  time  programs  remain  permanently  in  core, 
and  they  may  not  be  swapped  out  of  core  or  time  sliced. 

The  remaining  time  is  divided  among  the  demand  users  and  the  batch 
users.  Two  parameters,  DMAX  and  DMIN,  are  set  at  system  generation  time. 
The  DMIN  parameter  guarantees  demand  users,  taken  cumulatively,  a  certain 
percentage  of  the  computer  time  left  over  after  real  time  users  have  been 
serviced.  Perhaps  DMIN  will  be  set  at  15%  of  the  remainder  of  a  total 
day's  operation.  I  think  you  can  visualize  how  this  time  is  used.  It  is 
used  primarily  in  short  bursts  of  time.  The  mathematician  has  just  written 
a  Fortran  IV  program  to  solve  differential  equations  by  the  Runge-Kutta 
and  Adams  methods.  He  arranges  for  a  printout  of  the  Runge-Kutta  points 
as  an  intermediate  step  before  he  applies  the  Adams  predictor  -  corrector 
equations.  So  after  he  goes  on  line  to  the  computer  and  has  identified 
himself  and  typed  in  his  program,  or  run  it  in  from  a  paper  tape  that  he 
has  punched  off-line,  he  runs  the  program  and  inspects  the  Runge-Kutta 
coordinates.  He  finds  that  they  differ  from  his  pre-calculations,  and 
he  discovers  that  he  has  made  an  error.  He  corrects  the  error  by  typing 
in  the  correct  program  statements.  This  is  easy  to  do  because  he  is 
operating  in  the  demand,  or  conversational  mode  and  is  in  constant  con¬ 
tact  with  the  computer.  Now  he  runs  the  program  again.  This  time  Runge- 
Kutta  is  accurate  but  the  Adams  points  are  incorrect.  He  discovers  his 
error  in  the  predictor  equation,  makes  the  correction,  and  hits  the  run 
button  again.  Also,  he  may  discover  other  programming  errors  leading  to 
various  diagnostic  messages  such  as  overflow,  undefined  variables,  etc. 

But  finally  he  gets  his  correct  Adams  coordinates. 

Concurrently,  with  the  above  numerical  solution  of  differential 
equations  we  have  numerous  other  remote  users  going  on  line  to  the 
computer  and  using  a  large  number  of  short  bursts  of  time. 
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The  limit  to  the  total  amount  of  time  used  by  the  demand  users  is 
set  by  the  parameter,  DMAX.  Thus,  DMAX  and  DMIN  serve  to  provide  con¬ 
straints  on  the  demand  users.  And  this  insures  that  the  batch  users 
get  adequate  computer  time.  And  there  is  plenty  of  logic  in  this, 
because  no  one  wants  to  prevent  the  computer  from  computing  the  payroll; 
it's  the  most  important  batch  run  of  all! 

I  would  like  to  stop  at  this  time  and  look  ahead  to  the  future  a 
little  bit.  Some  of  the  research  that  I  have  done  in  recent  months  has 
led  me  to  believe  that  the  Army's  best  interests  would  be  served  if  some 
new  developments  are  made  and  then  specified  in  Army  requests  for  pro¬ 
posals  of  computing  equipment.  So,  I  would  like  to  talk  about  system 
simulators  at  this  time. 

We  were  talking  about  DMAX  and  DMIN  a  minute  ago.  These  parameters 
are  set  at  system  generation  time.  But,  it  would  seem  to  be  more  practical 
if  they  could  be  set  at  the  beginning  of  each  shift  by  the  manager  of  the 
computer  center.  Than  he  could  adjust  the  parameters  so  that  demand  users 
could  have  a  high  DMAX  during  prime  time  but  a  low  DMAX  on  the  swing  shift 
when  heavy  batch  work  is  in  progress.  Or  let  us  say  that  students  are 
given  the  computer  from  4  p.m.  to  midnight.  They  need  a  high  DMAX,  so  the 
computer  center  manager  gives  them  what  they  need  and  relegates  batch  jobs 
to  some  other  shift. 

This  would  help  solve  the  problem.  Otherwise,  in  order  to  change 
DMAX  and  DMIN  the  entire  executive  system  must  be  reassembled,  which  is 
an  involved  job  requiring  several  hours. 

Changing  an  executive  system  is  a  risky  operation  and  should  be 
done  carefully  under  tight  constraints.  But  if  in  so  doing  throughput 
can  be  greatly  increased,  it  might  be  worth  the  risk.  Certainly,  the 
manger  of  a  computing  system  will  not  be  forever  tolerant  of  an  inflexible 
executive  system,  because  the  executive  system  has  taken  over  many  of  the 
functions  formerly  performed  by  his  staff.  If  he  is  given  the  power  to 
adjust  such  parameters  at  the  beginning  of  each  shift,  and  if  in  so  doing 
he  can  increase  computer  throughput  by  the  dollar  equivalent  of,  say, 
$500,000  per  year,  then  I  think  you  will  agree  that  our  hypothetical 
manager  would  like  to  be  given  the  power  to  set  the  DMAX  and  DMIN  para¬ 
meters  at  the  beginning  of  each  shift.  But  the  big  question  is:  How 
does  he  determine  the  correct  settings? 

Trial  and  error  is  the  only  way  at  present.  But  the  use  of  trial 
and  error  methods  is  something  that  we  have  sought  to  avoid  in  other 
lines  of  work.  The  operations  research  profession  and  in  particular 
the  technique  of  digital  computer  simulation  have  developed  rapidly  in 
recent  years  primarily  to  enable  management  to  avoid  trial  and  error. 

We  simulate  transportation  systems,  inventory  systems,  communication 
systems,  etc.,  in  order  to  determine  in  advance  some  of  the  parameters 
of  these  systems.  We  can  thereby  increase  system  efficiency  by  correctly 
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setting  these  parameters  and  avoiding  the  consequences  of  hit  or  miss 
methods.  The  management  can  now  more  effectively  optimize  the  use  of 
the  resources  under  the  control  of  management. 


i 

i 

Why  can't  the  same  thinking  be  applied  to  the  digital  computer 
system  and  its  executive?  The  executive  system  is  a  manager  that  assumes 
the  burden  of  allocating  computer  resources  to  you  and  your  fellow  sci¬ 
entists  who  are  impatient  to  proceed  with  mathematical  programming,  solu¬ 
tion  of  systems  of  equations,  and  the  like.  Sooner  or  later,  we  will  be 
forced  to  place  this  manager  more  completely  under  our  control.  But  at 
the  present  time,  I  can't  find  much  evidence  that  this  is  being  done. 

Executive  systems,  operating  in  the  time  shared  mode,  are  still  experi¬ 
mental  and  they  are  not  too  well  documented.  They  have  required  so  many 
man-years  of  effort  to  develop  that  their  designers  have  apparently  not 
yet  given  attention  to  the  matter  of  system  simulation.  I  have  been 
probing  he  hardware  and  software  manufacturers  for  information  about 
simulation  of  executive  systems  without  much  success,  although  I  did 
pick  up  a  lead  that  one  particular  manufacturer  does  possess  a  highly 
proprietary  system  simulator  which  is  releasable  only  to  a  selected  few 
technical  people  within  that  company.  Perhaps  the  Army  should  start 
thinking  about  the  matter  of  putting  the  requirement  of  an  executive 
system  simulator  into  their  RFP's  some  time  in  the  early  1970's. 

Another  matter  that  interests  me  in  terms  of  RFP's  in  the  1970  time 
frame  is  the  requirement  of  a  piece  of  software  that  will  periodically 
assault  the  lock  and  key  system  of  third  generation  systems.  This  idea 
has  been  pushed  by  Bernie  Peters  of  the  National  Security  Agency  who, 
as  you  can  well  imagine,  is  very  much  concerned  with  system  security. 

I 

This  piece  of  software  would  periodically  test  the  safety  features 
of  the  executive  system  by  attempting  to  read  from  unauthorized  areas, 
and  the  like.  The  possession  of  this  piece  of  software  would  seem  to 
be  just  as  important  as  the  importance  to  which  you  attach  the  preserva¬ 
tion  of  classified  information  and  the  maintenance  of  the  integrity  of 
program  and  data  files.  Of  course,  you  can  provide  for  hardware  lockouts 
of  classified  files  by  isolating  them  on  drums  or  disks  so  that  they  are 
unreachable  by  software.  But  this  solves  only  part  of  the  problem.  There 
will  still  be  the  problem  of  maintenance  of  file  integrity  by  software 
and  software  alone. 

In  the  UNIVAC  1108  system,  the  master  directory  maintains  two  keys 
which  must  be  specified  on  an  assign  statement  to  gain  access  to  a 
catalogued  file.  One  key  is  the  read  key,  the  other  the  write  key,  and 
each  is  composed  of  up  to  six  characters,  all  being  legal  except  blank, 
slash,  comma,  and  semicolon.  Thus,  if  we  assume  that  you  use  a  six 
character  key,  there  is  only  one  chance  in  50,000,000  that  I  can  guess 
the  correct  key  for  your  file  and  thereby  correctly  read  information 
from  it  or,  in  a  different  situation,  attempt  to  destroy  it  by  writing 
into  it.  Probabilistically  speaking,  this  is  good  protection  and  probably 
adequate  for  most  purposes.  Of  course,  I  could  develop  a  computer  routine 
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that  could  create  all  possible  combinations  of  characters  and  seek 
repetitively  to  read  from  your  file.  But  each  time  I  attempted  such 
an  action,  the  executive  system  should  throw  me  off  the  computer.  So 
if  I  attempted  it  100  times  a  day,  it  would  still  take  me  thousands  of 
years  to  guess  your  key.  And  long  before  that,  the  executive  system 
should  have  alerted  management  to  the  fact  that  a  particular  user  was 
seeking  to  read  repeatedly  from  an  unauthorized  file  and  furnished  a 
count  of  the  number  of  times  that  I  had  tried  to  steal  your  information. 
Then  the  manager  of  the  system  could  see  that  I  am  apprehended. 

In  the  UNIVAC  1108  system,  protection  of  programs  in  main  memory 
is  achieved  by  both  hardware  and  software.  Each  program  is  allocated 
main  memory  space  in  blocks  of  512  words.  This  section  is  therefore 
locked  out  to  other  users.  This  insures  that  if  you  are  running  a 
program  in  conversational  BASIC  from  one  remote  terminal  and  I  am  doing 
conversational  FORTRAN  from  another  terminal,  our  programs  will  not 
wipe  out  each  other. 

There  are  many  other  aspects  of  the  security  problem  that  we  could 
discuss  at  this  time,  but  I  would  like  to  touch  briefly  on  several  other 
topics.  One  is  accounting. 

If  we  are  to  do  a  cost-effective  job  of  computer  procurement  and 
operation,  it  seems  necessary  that  we  have  a  reasonably  sophisticated 
accounting  system  under  the  control  of  our  executive.  Without  this 
system  we  don't  know  which  remote  terminals  are  being  used,  how  often 
they  go  on  line  to  the  computer,  how  long  they  stay  on  line,  etc.  We 
should  have  records  which  reveal  the  extent  to  which  main  memory  and 
peripherals  are  used.  Furthermore,  if  before  the  end  of  this  year, 

1969,  the  pricing  of  software  is  separated  from  the  pricing  of  hardware, 
we  will  have  to  consider  the  development  of  new  ways  of  performing 
benefit-cost  studies  on  software. 

Another  matter  of  importance  in  time  shared  systems  is  their  use  as 
educational  tools.  I  have  done  some  exploratory  thinking  about  the  pos¬ 
sibility  that  federal  employees  could  take  small  portable  consoles  home 
with  them  at  night  and  practice  writing  programs  in  languages  with  which 
they  are  not  too  familiar.  They  can  go  on  line  to  the  computer  from  their 
home  telephone,  practice  for  a  few  hours,  then  go  off  line.  The  printout 
of  night  users  of  the  system  will  reveal  what  they  have  done  and  they  can 
win  some  bonus  points  with  their  supervisor.  Also,  there  is  the  intriguing 
possibility  that  they  can  do  actual  work  from  their  homes  while  on  sick  or 
annual  leave.  Employees  with  respiratory  ailments  should  stay  home  in 
order  to  prevent  their  waging  biological  warfare  on  their  co-workers. 

Most  certainly  the  executive  system,  if  it  is  working  correctly,  is  an 
efficient  timekeeper  for  those  employees  working  from  their  home  consoles. 

/ 

There  is  the  further  possibility  that  government  employees  could  go 
on  line  at  night  from  their  homes  and  take  formal  courses  in  mathematics. 
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computer  sciences,  etc.  As  you  well  know,  there  are  many  computer 
programmers  who  could  greatly  improve  their  efficiency  by  learning 
a  little  more  about  calculus  and  finite  mathematics.  Maybe  we  should 
be  imaginative  and  give  them  the  opportunity.  The  University  of  Maryland, 
incidentally,  is  now  using  a  package  known  as  FOIL  for  the  purpose  of 
teaching  FORTRAN  from  remote  terminals. 

In  case  you  are  wondering  about  the  difficulties  of  carrying  heavy 
teletypes  home  with  you,  I  have  heard  recently  that  General  Electric 
is  marketing  a  new  remote  console  specially  designed  to  plug  into  your 
home  telephone.  I  don't  know  its  weight,  but  I  do  know  that  a  year  or 
so  ago  I  was  writing  a  program  in  BASIC  from  the  GE  225  remote  console 
at  American  University  and  had  just  exceeded  memory.  1  was  not  familiar 
with  the  EXTENDED  BASIC  language,  which  has  certain  memory  saving  instruc¬ 
tions  in  it,  so  I  called  up  a  General  Electric  Company  acquaintance  of 
mine  who  was  familiar  with  EXTENDED  BASIC.  He  told  me  that  he  was  busy 
all  day  but  to  call  him  that  night  at  home.  I  did  so,  and  gave  him  my 
user  number.  He  read  out  my  program  on  his  home  console,  called  me  on 
the  telephone  in  my  apartment,  and  told  me  where  I  could  substitute  an 
EXTENDED  BASIC  statement  or  two  for  the  BASIC  statements  in  my  program. 

I  made  the  changes  the  next  day  and  met  the  deadline. 

The  moral  of  this  story  is  that  time  shared  systems  provide  flexi¬ 
bility  and  convenience.  It  took  my  friend  only  a  few  minutes  at  home 
to  help  me  correct  my  program  by  teaching  me  a  few  instructions  in  a 
high  level  language  with  which  I  was  unfamiliar. 

Before  I  close  I  might  tell  you  about  the  results  of  a  brief  study 
I  made  on  man-Machine  response  time.  As  you  probably  know,  the  main 
reason  for  development  of  time  shared  systems  was  to  decrease  response 
time  for  the  users.  I  hypothesized  the  situation  where  there  was  a 
UNIVAC  1108  system  with  a  unit  processor  operating  correctly  under 
EXEC  8  at  my  agency  in  Olney,  Maryland,  and  that  there  were  remote  units 
installed  in  five  offices  in  the  Pentagon,  at  the  NRAC  classified  site, 
and  in  our  eight  Civil  Defense  Regions  throughout  the  United  States.  All 
fifteen  users  went  on  line  at  approximately  the  same  time  to  interrogate 
a  data  file  stored  on  a  Fastrand  Drum.  The  search  program  has  from  1,000 
to  10,000  machine  language  instructions  in  it  and  all  users  use  real  time. 
Direct  wires  to  the  1108  are  used.  What  is  the  turnaround  time? 

UNIVAC  estimated  1  1/2  second  turnaround  time  for  the  Pentagon  and 
no  more  than  3  1/2  seconds  for  replies  to  the  field.  Furthermore,  the 
batch  workload  at  Olney  would  be  held  up  no  more  than  about  one  second. 

I  think  you  will  agree  that  these  turnaround  times  are  quite  satisfactory. 

In  conclusion,  I  would  like  to  make  some  quick  recommendations  for 
improvements  in  modern  time  sharing  systems. 


1.  We  need  better  documented  executive  systems. 

Since  the  executive  system  is  in  charge  of  operation  of  the  computer 
system  -  allocating  time,  swapping  programs  in  and  out  of  memory,  giving 
each  user  a  slice  of  time,  etc.,  it  is  imperative  that  the  human  being 
manager  who  is  in  charge  of  a  computer  center  know  all  the  ins  and  outs 
of  what  his  executive  system  is  doing.  Otherwise,  the  human  manager 
doesn't  really  have  control  of  his  system.  And  this  is  a  situation 
which  is  the  antithesis  of  good  management.  It  is  also  uneconomical. 

It  is  impossible  to  make  good  cost-effectiveness  studies  on  a  computer 
system  if  the  manager  doesn't  know  what  is  taking  place  in  this  system. 

2.  We  need  simulators  to  simulate  the  operation  of  executive 
systems . 

With  this  scheme,  various  parameters  can  be  set  and  tested  by 
simulation  in  order  to  obtain  optimum  throughput  in  the  computer  system. 
This  avoids  the  trial  and  error  approach  -  an  approach  which  in  other 
management  situations  has  been  avoided  by  the  existence  of  simulation 
routines . 

3.  We  need  software  packages  which  assault  the  lock  and  key 
system  periodically  in  order  to  make  sure  that  the  executive 
system  is  protecting  the  integrity  of  user  files,  both  pro¬ 
gram  and  data. 

4.  We  need  much  more  research  in  benefit-cost  studies  of  computer 
systems.  Particularly  is  this  important  if,  in  the  near  future, 
pricing  of  software  is  separated  from  the  pricing  of  hardware. 

5.  We  need  a  tremendous  amount  of  research  in  the  writing  of 
specifications  for  procurement  of  computer  systems. 

I  thank  you  very  much  for  inviting  me  to  speak  to  you  today  and 
hope  that  you  will  invite  me  back. 
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Time  is  shared  between  two  tasks:  Task  A,  a  high-priority  task,  and  Task  B, 
a  low-priority  task.  Task  A  controls  the  CPU  whenever  it  is  able  to  process 
data.  The  sharing  of  time  is  at  irregular  intervals,  since  it  is  governed 
by  task  A's  processing  Requirements. 

At  a  point  in  its  processing,  Task  A  initiates  a  READ  operation  and  is  unable 
to  proceed  with  its  processing.  Task  B  is  the  given  execution  time,  while 
Task  A  waits  for  completion  of  that  READ  operation.  When  Task  A's  I/O  operation 
is  completed  and  its  processing  can  continue,  control  is  given  back  to  Task  A; 
Task  B  again  becomes  inactive.  Task  A  later  initiates  a  WRITE  operation  and 
must  wait  for  its  completion.  Task  B  again  receives  control  until  the  completion 
of  Task  A's  operation,  at  which  time,  Task  A  regains  control. 

Note:  All  transfers  of  control  between  tasks  are  made  on  the  basis  of  a  demand 
priority;  a  lower-priority  task  receives  control  only  when  a  high- 
priority  task  is  unable  to  proceed. 
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SLIDE  2 


P/////////IM  Task  Active 

Mllllllllim  Task  Waiting  for  I/O 

I  I  Task  Inactive 

Time  is  divided,  or  sliced,  in  two  distinct  ways.  If  a  task  is  unable  to  proceed,  control 
is  transferred  to  another  task  in  essentially  the  same  manner  as  in  Slide  1  (i.e.,  on  a 
demand  basis).  Time  is  also  shared  on  a  scheduled  basis. 

Task  A  has  initial  control  of  the  CPU.  At  point  A,  Task  A  initiates  a  READ  operation  and 
waits  for  its  completion;  Task  B  gains  control  of  the  CPU  for  processing.  At  point  B, 

Task  A's  READ  operation  is  completed;  Task  A  regains  control.  When  Task  A's  time  slice  is 
completed,  Task  B  receives  control.  Task  B  initiates  a  READ  operation  at  point  C  and  waits 
for  its  completion;  Task  C  is  given  execution  time.  Task  B's  READ  operation  is  completed 
at  point  D;  Task  B  regains  control.  When  Task  B's  time  slice  ends,  Task  C  gains  control 
and  processes  through  its  time  slice;  Task  A  then  gains  control  and  processes  through  its 
time  slice.  At  the  end  of  Task  A's  time  slice,  Task  B  receives  control  and  processes  until 
it  initiates  a  VJRITE  operation;  while  Task  B  waits  for  completion  of  this  I/O  operation, 
Task  C  proceeds.  When  Task  B's  I/O  operation  is  completed,  Task  B  regains  control  and 
processes  for  the  remainder  of  its  time  slice.  Task  C  regains  control  at  the  end  of  Task 
B's  time  slice;  during  its  processing,  it  initiates  a  READ  operation.  Task  A  processes 
while  Task  C  waits  for  completion  of  the  READ  operation.  When  the  I/O  operation  is 
completed,  Task  C  regains  control.  At  the  end  of  Task  C's  time  slice,  Task  A  regains 
control  and  processes  for  duration  of  the  time  slice. 
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ABSTRACT .  For  qualitative  personnel  distribution  (i.e., 
distribution  of  a  group  of  skilled  people)  ,  the  Army  is  currently 
divided  into  groupings  of  commands  called  priority  groups.  When 
the  worldwide  availability  of  personnel  is  less  than  the  total 
personnel  requirement,  some  method  of  distributing  available  personnel 
to  the  various  priority  groups  is  needed.  The  method  in  use  now  might 
be  called  "stepped  fill."  The  method  presented  here  consists  of  maxi¬ 
mizing  an  objective  function  which  is  made  up  of  a  weighted  sum  of 
fractional  fills  for  the  various  priority  groups.  The  fractional 
fills  are  constrained  to  meet  certain  conditions.  The  method  of 
solution  is  a  linear  programming  simplex  technique.  The  number  of 
priority  groups  is  easily  changed,  and  the  method  is  more  responsive 
to  Army  needs  than  tne  current  stepped  fill  method.  This  method  is 
presently  in  the  process  of  replacing  the  stepped  fill  computations. 


The  Army  has  established  a  priority  system  in  order  to  satisfy 
the  need  for  skilled  people  when  these  people  are  scarce.  Obviously, 
when  these  people  are  available  in  sufficient  number  to  satisfy  all 
requirements,  there  is  no  need  for  a  priority  system.  This  priority 
system  consists  of  assigning  each  unit  in  the  Army  to  a  priority  group, 
(there  may  be  anywhere  from  two  to  ten  priority  groups)  in  an  equitable 
manner.  Theoretically,  each  unit  in  a  given  priority  group  should  have 
the  same  percentage  of  its  needs  filled,  but  in  reality,  this  becomes  a 
goal.  There  is,  therefore,  a  need  to  determine  what  percent  fill  each 
priority  group  should  receive  based  on  both  the  limited  worldwide 
availability  of  people  and  the  interpriority  group  relationships  decided 
upon.  This  paper  outlines  the  way  the  Army  has  accomplished  this  in 
the  past,  and  then  presents  a  new  solution  to  the  problem. 

The  old  Army  method  of  priority  distribution,  using  three  groups 
as  an  example ,  was : 

1.  fill  group  1  to  a  specified  level 

2.  fill  group  2  to  a  different  (and  lower)  specified  level 

3.  fill  group  3  to  the  same  level  as  group  2 
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4.  raise  group  l's  specified  level  and  raise  groups  2  and  3 
levels  to  the  former  group  1  level 

5.  repeat  procedures  1,  2,  3,  and  4  until  there  are  no  people 
left  to  distribute. 

This  results  in  fill  levels  for  the  different  groups  based  on  a  relation¬ 
ship  between  the  groups  (the  specified  levels  at  which  changes  occur) 
and  the  worldwide  availability  of  people.  The  disadvantages  inherent 
in  this  procedure  are  obvious.  Why,  for  example,  should  the  high  priority 
group  continue  to  obtain  people  when  they  become  available  while  the  lower 
priority  groups  obtain  none  over  wide  ranges  of  availability?  In  addition, 
while  this  is  occurring,  why  are  the  low  priority  groups  maintained  at 
equal  fill  levels?  Another  disadvantage  is  that  a  change  in  the  distri¬ 
bution  of  requirements  among  the  groups  results  in  a  drastic  change  in 
relationship.  The  one  big  advantage  which  this  method  has  is  that  it 
is  easy  to  use.  The  one  big  disadvantage  is  that  it  is  extremely  dif¬ 
ficult  to  predict  the  effect  of  changing  the  number  of  groups. 

To  counteract  the  disadvantages  shown  above,  the  following  technique 
was  devised : 


Maximize  a  weighted  sum  of  fractional  fills  subject  to  the  constraints 
that  the  number  of  people  distributed  equal  the  worldwide  availability 
that  no  fill  exceed  100%,  and  that  the  ratio  of  the  fill  of  any  group 
to  the  fill  in  the  first  group  be  equal  to  or  greater  than  some  specified 
value. 


Mathematically,  this  can  be  expressed  as: 

n 

Maximize  ^ 

i=l 
n 

Subject  to  ^ 


Ci  Xi 


xi  zi  =  Y 


i=l 


Xi  <  1  , 


i  =  1 . n 


where  X 
Z 


i 

i 


=  fractional  fill  of  requirements  for  the  ith  group 
=  requirements  for  i^  group 
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Y  =  number  of  people  available  worldwide 
=  a  value  placed  on  a  priority  group 
=  a  weighting  factor 


A  first  attempt  at  a  solution  included  the  relationship  in  the 
weighting  factors,  but  this  cannot  be  done.  Instead,  the  weighting 
factors  must  be  determined  by  the  relationships  among  the  requirements 
to  insure  that  the  incremental  contribution  of  each  group  toward  maxi¬ 
mizing  the  objective  function  is  in  line  with  that  group^s  priority. 
Mathematically,  this  is: 


Arbitrarily  choosing  Ch  =  1,  the  successive  inequalities  can  be  solved, 
resulting  in 


C. 

1 


•9  Ci-1  Zi 


Ji-1 


The  factor  used,  .9,  is  not  significant,  since  any  number  less  than 
1  will  satisfy  the  inequality. 

If  the  authorization  for  any  group  is  0,  that  group  is  eliminated 
from  consideration  in  the  solution  for  C^,  and  the  weighting  factor 

associated  with  that  group  is  set  to  zero  for  the  remainder  of  the 
solution. 

In  getting  approval  for  this  method  it  has  been  found  easiest 
to  present  the  method  to  those  who  are  unfamiliar  with  this  type  of 
analysis  as  follows: 

"Based  on  a  value  of  100  for  group  1,  what  value  do  you  feel 
should  be  attached  to  the  lower  priority  groups?"  Once  this  decision 
has  been  made,  a  run  is  made  using  these  relationships  in  a  few  different 
cases  of  extreme  authorization  distributions  and  the  results  of  these 
runs  are  shown  to  the  decision  maker  for  approval.  Typically,  it  has 
taken  only  two  or  three  runs  to  get  a  decision  maker  to  the  point  where 
he  has  a  feel  for  what  will  result  from  changing  the  relationships.  Once 
the  decision  maker  has  reached  this  point,  he  is  in  a  position  to  better 
control  the  priority  distribution  of  Army  personnel  since  he  can  bring 
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groups  closer  together  or  farther  apart  with  one  easy  decision.  Under 
the  old  method  there  was  no  such  easy  method  of  controlling  the  relation¬ 
ship  between  groups,  although  it  was  there  implicitly  in  the  decision 
about  the  plateau  levels. 

One  of  the  biggest  advantages  of  this  concept  over  the  old  method 
is  the  ease  with  which  the  number  of  priority  groups  can  be  changed.  All 
that  is  required  is  the  decision  on  where  the  new  group  or  groups  fit  in 
and  what  value  they  should  have  relative  to  the  highest  priority  group. 
The  linear  programming  simplex  tableau  used  to  solve  this  problem  while 
it  was  being  developed,  or  any  other  method,  will  readily  accept  the 
number  of  priority  groups  as  a  parameter. 


SOME  NONMETRIC  ASPECTS  OF  BIOLOGY 


Pasqual  V.  Perrino 
Walter  Reed  Army  Medical  Center 
Washington,  D.  C. 


The  basic  problems  of  cellular  biology  are  concerned  essentially 
with  regulation;  i.e.,  the  process  by  which  a  cell  is  able  to  modify 
its  environment  in  response  to  exogenous  and  endogenous  stimuli.  The 
current  concensus  in  biology  seems  to  be  that  for  a  complete  under¬ 
standing  of  biological  control,  a  systematic  physico-chemical  (i.e., 
structural)  fractionation  of  organisms  with  an  intensive  study  of  the 
physical  and  chemical  properties  of  the  resulting  smaller  subdivisions 
is  both  necessary  and  sufficient.  This  paper  is  concerned  with  a 
comparison  of  the  structural  and  functional  approaches  to  the  problem 
of  biological  control  and  regulation. 

The  implications  of  the  structural  approach  to  biology  are  that 
a  suitable  fractionation  will  provide  fractions  whose  behavior  in  vitro 
will,  at  least  to  a  first  approximation,  mirror  its  behavior  in  the  intact 
organism.  It  furthermore  assumes  that  all  of  the  original  properties  of 
the  organism  can  be  understood  if  one  has  a  complete  understanding  of  a 
suitable  set  of  fractions  of  the  original  organism.  There  are,  however, 
situations  in  which  these  assumptions  do  not  appear  to  be  well  founded. 
Allosteric  enzyme  inhibition  (where  the  substrate  and  inhibitor  generally 
bind  on  distinct  sites  on  the  enzyme)  is  a  good  example  of  a  single  physico¬ 
chemical  particle  which  engages  in  a  number  of  functional  activities.  In 
this  case  the  various  functional  activities  of  the  enzyme  are  mediated  by 
various  sites  and  there  is  no  reason  to  believe  that  these  sites  could  be 
separated  into  separate  fractions  by  physico-chemical  techniques. 

This  very  problem  was  encountered  in  the  field  of  cardiac  physiology. 
Until  recently,  it  was  believed  that  the  mechanism  demonstrated  in  the 
isolated  heart  (the  heart-lung  preparation)  was  a  major  factor  controlling 
stroke  volume  in  the  intact  animal.  In  exercise,  the  venous  return  is 
increased  by  the  action  of  the  muscle  and  thoracic  pumps.  It  was  felt 
that  this  increased  venous  return  caused  cardiac  dilation  with  subsequent 
increased  cardiac  output  (Starling's  law).  In  the  intact  animal,  however, 
there  is  no  rise  in  venous  pressure  during  exercise  and  the  heart  does  not 
dilate  to  any  degree. ^ 

At  the  present  time,  it  appears  that  the  increase  in  stroke  volume 
and  heart  rate  is  due  to  activity  in  the  sympathetic  cardiac  nerves.  At 
or  even  before  the  start  of  exercise,  the  heart  rate  increases,  apparantly 
as  a  result  of  psychic  stimuli  which  increase  the  rate  of  discharge  in 
these  nerves. 
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The  erroneous  conclusions  drawn  from  the  heart-lung  preparation 
were  the  result  of  "fractionating"  out  of  the  experimental  system,  a 
set  of  elements  which  are  an  integral  part  of  the  functioning  cardio¬ 
vascular  system  in  the  intact  animal;  i.e.,  the  sympathetic  nervous 
system. 

On  the  other  hand,  engineers  are  often  concerned  with  the  simulation 
of  certain  aspects  of  some  physical  system  employing  an  entirely  different 
physico-chemical  system.  Simulations  on  an  analog  computer  are  a  typical 
example.  The  possibility  of  simulating  the  activities  of  one  system  by 
means  of  another  system  whose  physical  structure  is  unrelated  to  the 
system  of  interest  implies  the  belief  that  there  are  functional  properties 
which  are  common  to  both.  If  this  were  not  the  case,  one  would  be  able 
to  simulate  a  system  of  interest  only  by  employing  another  system  of 
similar  physico-chemical  composition.  This,  as  we  know,  is  not  the  case. 

Thus,  we  are  led  to  the  following  conclusions: 

1.  Two  functionally  equivalent  systems  may  have  no  common 
structural  feature. 

2.  There  is  no  way  of  ascertaining  functional  activity  from 
a  study  of  physical  landmarks. 

Therefore,  it  is  to  be  expected  that  a  functional  description 
will  be  an  important  factor  in  achieving  an  insight  into  the  mechanism 
of  biological  control  and  regulation. 

THE  ABSTRACT  TWO  FACTOR  MODEL.  All  theories  of  control  and  regulation, 
however  abstract  they  may  appear,  are  most  simply  regarded  as  refinements 
and  extensions  of  the  formalism  of  Newtonain  mechanics.  In  the  terminology 
of  Rosen^,  a  dynamical  system  is  defined  as  the  totality  of  possible 
states  of  the  system,  together  with  a  dvnamical  law  (enuatinns  of 
motion)  such  that,  given  any  initial  state  of  the  system,  the  state  at 
any  subsequent  time  is  uniquely  determined  by  the  initial  state  and 
the  dynamical  law.  A  dynamical  system  is  thus  a  couple,  consisting 
of  a  state  space  S  and  a  1-parameter  family  {f  }  of  transformations 

of  S,  such  that  if  seS  is  any  initial  state  and  T  any  subsequent  time, 
the  state  of  the  system  at  time  T  is  f^,(s).  An  observable  of  the  system 

( S ,  {f ^  })  is  a  mapping  from  the  state  space  S  into  the  real  numbers. 

Let  us  consider  systems  which  can  be  described  by  two  abstract  state 
variables,  x  and  x„.  The  state  space  for  this  system  is  thus  ordinary 

two-dimensional  space.  We  postulate  our  equations  of  motion  as  follows: 
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X  s 


*^X2  =  b  X  S  - 

dt  2 


(2) 


where  and  are  the  characteristic  roots  of  equation  1. 

We  now  define  an  observable,  f(x^,x2),  of  the  system  in  which  we 
are  interested  as  follows: 


f(x1,x2)  =  0 

if 

X1  -  X2 

f(xlfx2)  =  1 

if 

X1  "  X2 

(3) 


When  x^  >  x^,  we  shall  say  that  the  system  is  active  and  when  x^  <_  x^, 

we  shall  say  that  the  system  is  quiescent.  We  will  be  concerned  with 
initial  conditions  for  which  x^(0)  <  x^CO)  -  i.e.,  for  which  the  dynamical 

system  is  initially  off.  Equation  2  can  be  solved  to  yield,  for  a  constant 
stimulus  S: 


x1(t)  =  x^  (0)  +  (bl^1)(l  -  expd-o^t)) 
x2(t)  =  x^(0)  +  (b2S/a2)(l  -  exp(l-a2t)) 


(4) 
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where  we  have  taken  A  and  p  to  be  1.  These  functions  are  monotonic 
and  increasing  and  approach  asymptotic  values  of 


x^oo)  =  x1(0)  +  b1S/oi1 
*2  (“)  =  x2  (0)  +  b2S/,Qt2 


(5) 


There  are  essentially  four  types  of  behavior  which  may  be  elicited 
from  the  two  factor  model,  depending  upon  the  structural  parameters. 
These  types  of  behavior  are  illustrated  in  Figure  1. 

In  Figure  1A,  x^(t)  rises  so  slowly  that  it  never  intersects  X2(t) 

and  the  system  remains  quiescent.  In  Figure  IB,  x^(t)  =  X2(t)  for 

exactly  one  time  t*.  In  Figure  1C,  x^(t)  exceeds  f°r  the  period 

t^  <_  t  _<  t2  and  the  system  will  be  active  during  this  time  interval.  In 

Figure  ID,  x^(t)  exceeds  X2(t)  at  time  t*  and  thereafter  as  long  as  the 

stimulus  S  is  continued.  In  addition  to  the  constant  stimulus,  we  can 
also  easily  treat  a  stimulus  of  the  form  of  a  pulse  or  a  square  wave. 

In  a  manner  similar  to  that  above,  we  can  show  that  if  the  stimulus  S 
is  of  one  of  the  three  forms  just  mentioned,  then  the  output  must  be 
of  one  of  these  three  forms.  This  suggests  the  possibility  of  con¬ 
structing  networks  of  two  factor  elements. 

The  simplest  two  factor  network  is  illustrated  in  Figure  2,  the 
series  network.  Assuming  that  all  elements  have  identical  parameters, 
the  equations  of  motion  of  this  system  are  as  follows: 


dx. 


dt  A1S  '  “lXl 


dyi 


dt  A2S  "  a2yl 


dx? 

AiY(xi’yi}  '  aix2 


(6) 


dy2 

"dt  =  A2Y(xl’yl}  '  a2y2 
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. . . . . . . . 


dx 


—  -  .Vj)  -  a!xn 


dy 


n 


dt  '  ¥<Vi'Vi>  ’  V„ 


where  the  x.,y.  are  the  state  variables  for  the  i-th  two  factor  element 
11 

and  Y (x^ ,y^)  =  0  if  x±  <_  y±  and  Y(xi>yi)  =  1  if  x.  >  y±. 

If  the  stimulus  S  is  great  enough  to  cause  the  first  element  to 
activate,  then  all  subsequent  elements  in  the  series  will  be  activated. 
Furthermore,  if  the  output  of  the  entire  series  network  is  taken  to  be 
the  output  of  the  n-th  element,  then  the  intensity  of  the  output  is 
independent  of  the  intensity  of  the  input. 

We  can  also  calculate  the  reaction  time  for  an  individual  element 
in  the  series  -  i.e.,  the  time  lag  between  the  beginning  of  stimulation 
and  the  appearance  of  activation.  For  the  i-th  two  factor  element, 
activation  will  occur  when  x^(t)  =  y^(t).  If  we  assume  that  t<<l,  the 

activation  time,  t*  is  given  by 
i 


ti  =  +  (Aq  "  A2)/((yi(0)a2  -  xi(0)a1)  +  (A1  -  )  (7) 


and  the  reaction  time,  t  for  the  entire  system  is  given  by 


t* 


■  Ih 


(3) 


In  addition  to  the  simple  series  network,  we  can  also  construct  a 
two-factor  discrimination  network  as  illustrated  in  Figure  3.  The 
equations  of  motion  of  this  system,  assuming  both  elements  have  identical 
parameters ,  are  given  by 


A1S1  " 


“lXl 


^1 

dt 


A2S1  +  BY(x2,y2) 


a2yi 


(9) 
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dt  =  A1S2  “  alX2 
dy2 

—  =  A2S2  +  BY(x1>yi)  -  a2y2 


where  the  notation  is  identical  with  that  of  equation  6. 

Solving  the  equations  of  motion  of  this  system  we  find  that  the 
solution  for  the  x^,  i  =  1,2,  is  the  same  as  the  solution  for  equation  2. 

However,  the  solutions  for  the  y ^ ,  i  =  1,2,  are  as  follows: 


yi  =  ^A2Si^a2^1-exp^_0t2t^  ^  +  ,y^) /a2)  (l-exp(-a2t) )) 


(10) 


-  y2(0) (exp(-a2t)) 


where  j  =  1  if  i  =  2  and  j  =  2  if  i  =  1. 

If  B  is  large  enough,  then  if  at  time  t  =  0  the  inputs  (stimuli) 
and  S2  which  are  of  constant  intensity,  are  presented  to  the  network, 

then  there  will  be  three  possible  results: 


a. 

if 

S1 

>  S2  ’ 

the 

response  R^ 

will 

occur 

b. 

if 

S1 

<  V 

the 

response  R2 

will 

occur 

c. 

if 

S1 

=  V 

there  will  be  no  response 

This  network  is  capable  of  discriminating  the  relative  intensities  of 
the  stimuli  and  S2- 

REALIZATIONS  OF  THE  ABSTRACT  TWO-FACTOR  MODEL.  If  we  are  given  a 
set  of  formal  (mathematical)  relations,  then  any  physical  system  which 
embodies  these  relations  is  called  a  realization  of  these  relations. 

When  we  say  that  two  systems  are  analogous,  we  mean  that  they  are 
alternate  realizations  of  the  same  formal  model.  That  is,  there  is  a 
physical  correspondence  between  the  two  systems  which  preserves  dynamical 
properties.  Therefore  the  study  of  any  system  provides  insight  into  the 
properties  of  all  of  its  analogs. 
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From  equations  2  and  3,  we  see  that  with  respect  to  the  observable 
(output)  we  have  defined,  x^  is  an  excitatory  factor  and  x ^  is  an 

inhibitory  factor.  From  the  form  of  equation  2,  we  see  that,  in  a  two- 
factor  element,  both  excitatory  and  inhibitory  factors  are  produced  at 
a  rate  proportional  to  the  stimulus  S  and  removed  at  a  rate  proportional 
to  their  values. 


Thus,  we  may  expect  a  physical  system  to  be  a  realization  of  a 
two-factor  model  whenever  a  process  represents  an  interaction  between 
excitatory  and  inhibitory  factors  and  the  interaction  obeys  the  law  of 
mass  action.  A  two  factor  model  was  first  proposed  by  Rashevsky1^  as  a 
model  for  peripheral  nerve  excitation.  This  model  was  quite  successful 
in  demonstrating  many  aspects  of  neural  excitation.  Subsequently,  the 
two  factor  model  was  employed  to  model  certain  properties  of  the  central 
nervous  system. As  these  models  are  explained  in  detail  elsewhere, 
they  will  not  be  considered  further  here. 


Considering  the  simple  series  network  of  two-factor  elements,  we 
see  that  it  embodies  many  aspects  of  a  neuron.  It  will  respond  to  a 
threshold  or  superthreshold  stimulus,  but  not  to  a  subliminal  stimulus. 

As  the  output  is  independent  of  the  intensity  of  the  stimulus  (provided 
the  stimulus  exceeds  the  threshold)  ,  it  models  the  "all  or  none"  properties 
of  the  neuron.  We  also  note  that  "excitation"  jumps  from  element  to  ele¬ 
ment  with  a  delay  of  t*  for  the  i-th  element.  This  differs  from  the 

action  of  a  single  two-factor  element.  Thus,  the  series  network  models 
the  action  of  myelinated  neurons  (saultatory  conduction)  while  the 
single  two-factor  element  models  the  action  of  an  unmyelinated  neuron. 


Turning  to  the  discrimination  network  of  Figure  3,  we  note  that  this 
same  network  was  employed  by  Landahl^>^  in  his  model  for  psychophysical 
discrimination.  That  a  two-factor  switching  network  can  realize  a 
nervous  network  does  not  seem  surprising,  however,  it  is  very  interesting 
to  note  that  other,  apparently  entirely  different  biological  systems  can 
be  described  by  a  similar  network.  Certain  aspects  of  the  operator  model 
of  Jacob  and  Monod^  lends  itself  to  this  description  very  nicely.  This 
model  involves  the  following  assumptions: 


a.  The  primary  structure  of  a  polypeptide  chain  is  determined 
by  a  DNA  word,  called  a  structural  gene  of  the  polypeptide. 

b.  Associated  with  each  structural  gene  is  a  region  called  the 
operator  which  is  the  site  which  initiates  the  transcription 
of  the  structural  gene.  The  complex  consisting  of  a  single 
operator  and  its  associated  structural  genes  is  called  an 
operon, 

c.  Associated  with  each  operon  is  a  distinct  entity  called  a 
regulator  gene.  The  regulator  gene  produces  a  substance 
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called  a  repressor  which  can  combine  reversibly  with  the 
corresponding  operator.  The  resulting  operator-repressor 
complex  then  blocks  the  transcription  of  the  regulator  gene. 

d.  Any  substance  which  can  antagonize  the  action  of  the  repressor 
is  called  an  inducer  and  systems  which  possess  inducers  are 
called  inducible. 

The  most  important  aspect  of  this  model  from  a  functional  point  of 
view  is  the  postulation  of  end  product  inhibition.  This  permits  us  to 
study  the  system  in  isolation  from  the  rest  of  the  system  as  the  speci¬ 
fication  of  end  product  inhibition  will  be  the  major  factor  in  the 
determination  of  the  equations  of  motion  of  the  system.  Therefore,  to 
a  first  approximation  at  least,  we  can  understand  the  properties  of 
this  subsystem  without  having  to  refer  back  to  the  original  system; 
i.e.,  it  induces  a  natural  decomposition  of  the  original  state  space 
into  more  manageable  subspaces. 

In  this  subsystem,  according  to  the  model,  the  synthesis  of  an 
enzyme  P  depends  upon  the  interaction  of  two  types  of  molecules  which 
we  have  termed  inducer  and  repressor.  Therefore,  we  may  measure  the 
rate  of  synthesis  of  P  indirectly  by  measuring  the  rate  of  the  reaction 
A  -+■  B  which  P  catalyzes.  Assuming  a  one  to  one  stoichiometry  for  the 
interaction  of  inducer  and  repressor,  the  condition  for  the  syntheses 
is  that  the  concentration  of  the  inducer  exceed  the  concentration  of 
the  repressor.  Therefore,  if  we  are  interested  in  the  kinetics  of  the 
enzyme  P,  the  state  variables,  to  a  first  approximation,  will  be  the 
concentrations  of  the  inducer  and  repressor  substances.  In  addition, 
the  effect  of  any  chemical  stimulation  in  terms  of  its  effects  upon  a 
particular  regulator-operon  complex  can  in  turn  be  described  in  terms 
of  the  concentrations  of  the  appropriate  inducer  and  repressor. 

Therefore,  we  can  expect  the  time  rate  of  change  of  the  two  state 
variables  to  change  at  a  rate  proportional  to  their  concentrations. 

The  equations  of  motion  of  the  system  will  then  have  the  form  of 
equation  2  and  from  what  has  been  said  previously,  it  is  obvious  that 
equation  3  is  also  satisfied.  That  is  the  regulator-operon  complex  may 
be  regarded  as  a  linear  two-factor  element. 

The  network  shown  in  Figure  4  was  proposed  by  Jacob  and  Monod  as  a 
possible  explanation  of  how  networks  of  operon-regulator  complexes  could 
be  employed  to  explain  the  properties  of  differentiating  systems.  In 
this  model,  the  end  products  and  are  assumed  to  be  corepressors 

of  each  other.  Inspection  of  the  system  reveals  that  this  network  is 
capable  of  existing  in  one  of  two  possible  states  depending  upon  the 
substrate  concentration.  One  can  cause  the  system  to  change  state  by 
suitably  altering  the  substrate  concentrations.  Thus,  it  is  readily 
seen  that  the  network  of  Figure  4  is  simply  the  two-factor  discrimination 
network  of  Figure  3.  Thus,  this  model  is  formally  equivalent  to  Landahl's 
model  for  psychophysical  discrimination,  although  both  are  quite  different 
in  their  anatomical  and  physiological  details. 
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DISCUSSION.  In  addition  to  the  heuristic  desirability  of  a 
functional  approach  to  biology,  there  is  theoretical  justification  for 
a  functional  approach.  The  transformation  of  coordinates  which  were 
required  to  transform  equation  1  into  equation  2  imply  the  theoretical 
impossibility  of  physically  isolating  the  excitatory  or  inhibitory 
substances  postulated  by  the  two-factor  model.  The  transformation 
required  to  bring  equation  1  into  the  proper  form  also  requires  the 
transformation  of  the  old  state  variables  into  new  state  variables 
which  are  linear  combinations  of  the  former,  thus  implying  the  im¬ 
possibility  of  isolating  the  new  state  variables. 

We  also  see  that  a  fixation  upon  the  structural  a.spect  of  various 
dynamical  systems  can  easily  obsecure  basic  similarities  which  a  functional 
approach  can  elucidate.  Indeed,  the  much  admired  unity  of  physics  is 
based  upon  the  ability  to  abstract  from  differing  structural  systems, 
a  formal  (mathematical)  relation  which  is  common  to  all.  Thus,  a  second 
order,  linear  differential  equation  describes  equally  well  the  action  of 
a  mechanical  harmonic  oscillator  and  the  discharge  of  a  capacitor  through 
a  circuit  containing  an  inductance  and  a  resistance.  The  appearance  of 
the  same  formal  relation  governing  the  action  of  two  apparently  very  dif¬ 
ferent  biological  systems  gives  further  impetus  to  the  search  for  unifying 
principles  in  biology. 

Of  course,  one  should  not  lightly  dismiss  the  ideas  and  techniques 
thus  far  developed  by  a  structural  approach  to  biology.  Rather  it  is 
hoped  that  a  proper  combination  of  the  functional  and  structural  approach 
will  provide  a  more  satisfying  description  of  biology  than  either  could 
alone. 
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